00000001:02000400:1.0F:1787364658.293756:0:2967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787364683.001611:0:3190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787364684.943716:0:3253:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 615 MB/s 00000001:01000000:0.0F:1787364685.195605:0:3253:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 539 MB/s 00000001:01000000:2.0:1787364685.444845:0:3253:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2519 MB/s 00000020:02000000:2.0:1787364686.341979:0:3282:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_47_gae0d133 00000400:02000000:3.0:1787364687.413263:0:3297:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.102@tcp [8/256/0/180] 00008000:02000000:0.0:1787364691.336174:0:3447:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787364747.214883:0:5256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787364757.951641:0:5837:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787364757.951647:0:5837:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787364757.951764:0:5837:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a9b7d2b0 00000080:02000400:3.0:1787364757.951776:0:5837:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787364757.957889:0:5837:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787364757.957904:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787364757.957944:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002012c1a0) 00000020:00000080:3.0:1787364757.957963:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787364757.980918:0:5837:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787364757.981291:0:5837:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787364758.022020:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787364758.022059:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787364758.022077:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787364758.022137:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787364758.022159:0:5837:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787364758.022713:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787364758.022721:0:5837:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787364758.022732:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2ab54 00000020:01000004:3.0:1787364758.022833:0:5837:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787364758.022839:0:5837:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787364758.022847:0:5837:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a9b7d2b0 from MGS 00000020:01000004:3.0:1787364758.022852:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787364758.022865:0:5837:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000062902a30) 00000020:00000080:3.0:1787364758.022876:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787364758.022992:0:5837:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a9b7d2b0 from MGS, refs=2 00080000:01000000:3.0:1787364758.022997:0:5837:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787364758.023002:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2ab62 00000100:00100000:3.0:1787364758.023155:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787364758.023376:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787364758.023383:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787364758.023958:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787364758.023967:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787364758.027105:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787364758.027308:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787364758.027314:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787364758.028655:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787364758.028668:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787364758.030577:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787364758.030597:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787364758.031629:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364758.031633:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364758.031635:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364758.034236:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364758.034243:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364758.034245:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364758.035100:0:5837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787364758.047416:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787364758.287815:0:5837:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2237 MB/s 00000001:01000000:2.0:1787364758.539452:0:5837:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4390 MB/s 00000001:01000000:3.0:1787364758.791964:0:5837:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 474 MB/s 00000001:01000000:2.0:1787364759.042280:0:5837:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 791 MB/s 00080000:10000000:2.0:1787364759.050238:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1787364759.051090:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787364759.072944:0:5837:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787364759.072960:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787364759.072962:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787364759.080542:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787364759.080621:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787364759.080679:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787364759.080988:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787364759.081016:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787364759.081339:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787364759.081518:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787364759.081525:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787364759.082407:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787364759.082416:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787364759.083119:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787364759.083127:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787364759.083714:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787364759.083735:0:5837:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.102@tcp' 00000020:01000004:0.0:1787364759.083737:0:5837:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787364759.083900:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.102@tcp (typ=mgc) 00000020:00000080:0.0:1787364759.083920:0:5837:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.102@tcp (00000000a0eb0207) 00000020:00000080:0.0:1787364759.083936:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787364759.084058:0:5837:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000059eaa708@MGC192.168.204.102@tcp: add connection 192.168.204.102@tcp at head 00010000:00010000:0.0:1787364759.084213:0:5837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.102@tcp-0 is initialized 00000040:01000000:0.0:1787364759.084220:0:5837:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.102@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787364759.086130:0:5852:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787364759.090635:0:5853:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787364759.090862:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.102@tcp (uuid 8853f36b-eb15-4321-aed5-724dfa11fdc2) 00000020:00000080:2.0:1787364759.090886:0:5837:0:(genops.c:1385:class_connect()) connect: client 8853f36b-eb15-4321-aed5-724dfa11fdc2, cookie 0xcfc9272e5fc2ab70 00000100:00080000:2.0:1787364759.090898:0:5837:0:(import.c:510:import_select_connection()) MGC192.168.204.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787364759.090903:0:5837:0:(import.c:624:import_select_connection()) MGC192.168.204.102@tcp: import 0000000059eaa708 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:2.0:1787364759.090946:0:5837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002bcfecaf x1874187714035840/t0(0) o250->MGC192.168.204.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787364759.090971:0:5837:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS 00000020:01000004:2.0:1787364759.090990:0:5837:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787364759.090996:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787364759.091015:0:5837:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a440f3e5) 00000020:00000080:2.0:1787364759.091029:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787364759.099123:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bcfecaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8853f36b-eb15-4321-aed5-724dfa11fdc2:3312:1874187714035840:0@lo:250: 00000100:00100000:3.0:1787364759.099218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364759.101052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714035840 00000100:00100000:0.0:1787364759.101064:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714035840 00000100:00100000:0.0:1787364759.101108:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364759.101115:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000430c9d9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1874187714035840:12345-0@lo:250: 00010000:00080000:0.0:1787364759.101145:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8853f36b-eb15-4321-aed5-724dfa11fdc2@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1787364759.101184:0:5849:0:(genops.c:1385:class_connect()) connect: client 8853f36b-eb15-4321-aed5-724dfa11fdc2, cookie 0xcfc9272e5fc2ab7e 00000100:00080000:0.0:1787364759.101345:0:5849:0:(import.c:65:import_set_state_nolock()) 000000001473000e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787364759.101442:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000430c9d9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:3312:x1874187714035840:12345-0@lo:250: Request processed in 326us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364759.101450:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787364759.102282:0:3312:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787364759.102293:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.102@tcp: connect to target with instance 0 00000100:00080000:3.0:1787364759.102301:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787364759.102306:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787364759.102309:0:3312:0:(import.c:65:import_set_state_nolock()) 0000000059eaa708 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787364759.102312:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787364759.102334:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787364759.102340:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bcfecaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8853f36b-eb15-4321-aed5-724dfa11fdc2:3312:1874187714035840:0@lo:250: 00000100:00100000:2.0:1787364759.118872:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787364759.119078:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787364759.119084:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787364759.120637:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787364759.120647:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787364759.120997:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787364759.121003:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787364759.121641:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787364759.121862:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787364759.121867:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787364759.123221:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787364759.123232:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787364759.157427:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787364759.157737:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787364759.157744:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787364759.159148:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787364759.159159:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787364759.159773:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787364759.159984:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787364759.159996:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787364759.167277:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787364759.167298:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787364759.168248:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787364759.168442:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787364759.168447:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787364759.171837:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787364759.171854:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787364759.172978:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787364759.173449:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787364759.173457:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787364759.176365:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787364759.176381:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787364759.232019:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787364759.232538:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787364759.232546:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787364759.238421:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787364759.238440:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787364759.240227:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787364759.240243:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787364759.242553:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787364759.242582:0:5837:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787364759.242588:0:5837:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787364759.242727:0:5837:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787364759.242775:0:5837:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.102@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787364759.242781:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787364759.242814:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787364759.242816:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787364759.242817:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787364759.242818:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787364759.242819:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787364759.242821:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787364759.242822:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787364759.242829:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787364759.242830:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787364759.242831:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787364759.242832:0:5837:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787364759.242834:0:5837:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787364759.242837:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787364759.242838:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787364759.242839:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787364759.242839:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787364759.242840:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787364759.242841:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787364759.242842:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787364759.242843:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787364759.242844:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787364759.242844:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787364759.242845:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787364759.242846:0:5837:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787364759.242880:0:5837:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787364759.242898:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004f6caab pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714035968:0@lo:253: 00000100:00100000:1.0:1787364759.243097:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364759.243208:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000006453598e going to sleep for 11 seconds 00000100:00100000:0.0:1787364759.243324:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714035968 00000100:00100000:0.0:1787364759.243331:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714035968 00000100:00100000:0.0:1787364759.243372:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364759.243380:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3cb550c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:5837:x1874187714035968:12345-0@lo:253: 20000000:01000000:0.0:1787364759.243420:0:5851:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787364759.243423:0:5851:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787364759.246225:0:5872:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787364759.246371:0:5851:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787364759.246719:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787364759.252091:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787364759.253256:0:5851:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787364759.253261:0:5851:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787364759.253268:0:5851:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787364759.253271:0:5851:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787364759.253286:0:5851:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787364759.253554:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787364759.253836:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787364759.253849:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787364759.253901:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787364759.254390:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787364759.254436:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787364759.254536:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787364759.254544:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787364759.254590:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787364759.254598:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787364759.254629:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787364759.254636:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787364759.254664:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787364759.254712:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787364759.254742:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787364759.254747:0:5851:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787364759.254758:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787364759.256425:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787364759.256455:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787364759.256512:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787364759.256543:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787364759.256584:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787364759.256600:0:5851:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787364759.256700:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787364759.256708:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787364759.256750:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787364759.256820:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787364759.256866:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787364759.256877:0:5851:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787364759.258278:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787364759.258300:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787364759.258371:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787364759.258410:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787364759.258607:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787364759.258658:0:5851:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787364759.258665:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787364759.262118:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787364759.262678:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787364759.262707:0:5851:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.102@tcp for mdt 20000000:01000000:0.0:1787364759.262710:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.102@tcp (null) (null) (null) 00000040:00080000:0.0:1787364759.262747:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787364759.262755:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787364759.262821:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787364759.262831:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.102@tcp (null) (null) 00000040:00080000:0.0:1787364759.262885:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787364759.262898:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787364759.262932:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787364759.263150:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787364759.263232:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787364759.263237:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787364759.263253:0:5851:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787364759.263259:0:5851:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787364759.263732:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787364759.263929:0:5851:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787364759.271544:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787364759.271600:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787364759.271676:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787364759.271698:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787364759.271701:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787364759.271705:0:5851:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787364759.271744:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787364759.271747:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787364759.271778:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787364759.271781:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787364759.272534:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787364759.272915:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787364759.272958:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787364759.273004:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787364759.273014:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787364759.273016:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787364759.274094:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1787364759.274396:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1787364759.274438:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1787364759.274503:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1787364759.274517:0:5851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787364759.274520:0:5851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1787364759.274527:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787364759.274545:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274561:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274570:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274588:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274595:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274601:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274607:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055c3a255 already unused, calling callback (00000000685e2d34) 00010000:00010000:0.0:1787364759.274611:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274619:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274632:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274638:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364759.274644:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ab85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787364759.274658:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787364759.492303:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3cb550c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:5837:x1874187714035968:12345-0@lo:253: Request processed in 248908us (249190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364759.492334:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787364759.492499:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004f6caab pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714035968:0@lo:253: 10000000:01000000:3.0:1787364759.492516:0:5837:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787364759.492519:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787364759.492521:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787364759.492522:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787364759.492524:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787364759.492525:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787364759.492526:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787364759.492528:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787364759.492529:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787364759.492530:0:5837:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787364759.492532:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787364759.492533:0:5837:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787364759.492554:0:5837:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a9b7d2b0 from lustre-MDT0000 10000000:01000000:3.0:1787364759.492578:0:5837:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787364759.492581:0:5837:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787364759.492585:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b6d04f519b8 10000000:01000000:3.0:1787364759.492589:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787364759.492597:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d04f519b8 from 1 10000000:01000000:3.0:1787364759.492600:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787364759.492654:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: 00000000c084b015/0xcfc9272e5fc2ab8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364759.492666:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: 00000000c084b015/0xcfc9272e5fc2ab8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364759.492675:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: 00000000c084b015/0xcfc9272e5fc2ab8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364759.492699:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009ac88515 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036096:0@lo:101: 00000100:00100000:3.0:1787364759.492733:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364759.492810:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4575832 going to sleep for 11 seconds 00000100:00100000:1.0:1787364759.492928:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714036096 00000100:00100000:1.0:1787364759.492935:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714036096 00000100:00100000:1.0:1787364759.492984:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787364759.492992:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000007f95aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:5837:x1874187714036096:12345-0@lo:101: 00010000:00010000:1.0:1787364759.493004:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364759.493017:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9b0c9fd/0xcfc9272e5fc2ab93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ab8c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.493038:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9b0c9fd/0xcfc9272e5fc2ab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.493054:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9b0c9fd/0xcfc9272e5fc2ab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.493063:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9b0c9fd, rc 0) 00000100:00100000:1.0:1787364759.493110:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000007f95aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+6:5837:x1874187714036096:12345-0@lo:101: Request processed in 118us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364759.493116:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787364759.493193:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009ac88515 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036096:0@lo:101: 00010000:00010000:2.0:1787364759.493206:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: 00000000c084b015/0xcfc9272e5fc2ab8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364759.493214:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: 00000000c084b015/0xcfc9272e5fc2ab8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364759.493259:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb62b7d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036224:0@lo:501: 00000100:00100000:2.0:1787364759.493286:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364759.493325:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e47507a going to sleep for 11 seconds 00000100:00100000:1.0:1787364759.493425:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714036224 00000100:00100000:1.0:1787364759.493430:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714036224 00000100:00100000:1.0:1787364759.493467:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787364759.493473:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dae407d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+6:5837:x1874187714036224:12345-0@lo:501: 00000100:00100000:1.0:1787364759.493675:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dae407d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+6:5837:x1874187714036224:12345-0@lo:501: Request processed in 202us (388us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787364759.493682:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787364759.493902:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb62b7d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036224:0@lo:501: 10000000:01000000:2.0:1787364759.493933:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787364759.493964:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: 00000000c084b015/0xcfc9272e5fc2ab8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364759.493972:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: 00000000c084b015/0xcfc9272e5fc2ab8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364759.493979:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d20269000 10000000:01000000:2.0:1787364759.493983:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787364759.493987:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b6d20269000 10000000:01000000:2.0:1787364759.493989:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787364759.493991:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b6d20269000 from 1 10000000:01000000:2.0:1787364759.493993:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787364759.494017:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: 00000000283a4cbe/0xcfc9272e5fc2ab9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364759.494024:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: 00000000283a4cbe/0xcfc9272e5fc2ab9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364759.494031:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: 00000000283a4cbe/0xcfc9272e5fc2ab9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364759.494042:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb62b7d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036352:0@lo:101: 00000100:00100000:2.0:1787364759.494068:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364759.494096:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e47507a going to sleep for 11 seconds 00000100:00100000:1.0:1787364759.494211:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714036352 00000100:00100000:1.0:1787364759.494216:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714036352 00000100:00100000:1.0:1787364759.494247:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787364759.494253:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b569223d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+6:5837:x1874187714036352:12345-0@lo:101: 00010000:00010000:1.0:1787364759.494261:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364759.494269:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f09f408/0xcfc9272e5fc2aba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ab9a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.494283:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f09f408/0xcfc9272e5fc2aba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ab9a expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.494300:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f09f408/0xcfc9272e5fc2aba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ab9a expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.494326:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f09f408, rc 0) 00000100:00100000:1.0:1787364759.494355:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b569223d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+7:5837:x1874187714036352:12345-0@lo:101: Request processed in 103us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364759.494361:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787364759.494543:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb62b7d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036352:0@lo:101: 00010000:00010000:2.0:1787364759.494555:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: 00000000283a4cbe/0xcfc9272e5fc2ab9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364759.494561:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: 00000000283a4cbe/0xcfc9272e5fc2ab9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364759.494572:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787364759.494575:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: 00000000283a4cbe/0xcfc9272e5fc2ab9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364759.494580:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: 00000000283a4cbe/0xcfc9272e5fc2ab9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364759.494585:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787364759.494589:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787364759.494593:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b6d20269000 10000000:01000000:2.0:1787364759.494596:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787364759.494604:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787364759.494606:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787364759.494620:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: 00000000861244c4/0xcfc9272e5fc2aba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364759.494626:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: 00000000861244c4/0xcfc9272e5fc2aba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364759.494633:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: 00000000861244c4/0xcfc9272e5fc2aba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364759.494644:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb62b7d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036480:0@lo:101: 00000100:00100000:2.0:1787364759.494667:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364759.494691:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e47507a going to sleep for 11 seconds 00000100:00100000:1.0:1787364759.494801:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714036480 00000100:00100000:1.0:1787364759.494806:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714036480 00000100:00100000:1.0:1787364759.494836:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787364759.494842:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a12ae0a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+7:5837:x1874187714036480:12345-0@lo:101: 00010000:00010000:1.0:1787364759.494849:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364759.494856:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a07e2a96/0xcfc9272e5fc2abaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2aba8 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.494868:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a07e2a96/0xcfc9272e5fc2abaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.494875:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a07e2a96/0xcfc9272e5fc2abaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364759.494880:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a07e2a96, rc 0) 00000100:00100000:1.0:1787364759.494918:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a12ae0a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+8:5837:x1874187714036480:12345-0@lo:101: Request processed in 77us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364759.494924:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787364759.494990:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb62b7d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036480:0@lo:101: 00010000:00010000:3.0:1787364759.495000:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: 00000000861244c4/0xcfc9272e5fc2aba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364759.495007:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: 00000000861244c4/0xcfc9272e5fc2aba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364759.495048:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036608:0@lo:501: 00000100:00100000:3.0:1787364759.495073:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364759.495100:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c73efd6e going to sleep for 11 seconds 00000100:00100000:1.0:1787364759.495148:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714036608 00000100:00100000:1.0:1787364759.495152:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714036608 00000100:00100000:1.0:1787364759.495179:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787364759.495185:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051af4a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+8:5837:x1874187714036608:12345-0@lo:501: 00000100:00100000:1.0:1787364759.495555:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051af4a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:5837:x1874187714036608:12345-0@lo:501: Request processed in 369us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364759.495569:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787364759.495640:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036608:0@lo:501: 00000100:00100000:3.0:1787364759.495668:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036736:0@lo:503: 00000100:00100000:3.0:1787364759.495705:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364759.495724:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c73efd6e going to sleep for 11 seconds 00000100:00100000:1.0:1787364759.495776:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714036736 00000100:00100000:1.0:1787364759.495780:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714036736 00000100:00100000:1.0:1787364759.495830:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787364759.495836:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007ae5f31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:5837:x1874187714036736:12345-0@lo:503: 00000100:00100000:1.0:1787364759.495973:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007ae5f31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:5837:x1874187714036736:12345-0@lo:503: Request processed in 138us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364759.495980:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787364759.496102:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714036736:0@lo:503: 00000100:00100000:3.0:1787364759.496571:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:5879:1874187714036864:0@lo:502: 00000100:00100000:3.0:1787364759.496606:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364759.496635:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bffab0b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364759.496690:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714036864 00000100:00100000:1.0:1787364759.496696:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714036864 00000100:00100000:1.0:1787364759.496763:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787364759.496770:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a171d35e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:5879:x1874187714036864:12345-0@lo:502: 00000100:00100000:1.0:1787364759.496943:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a171d35e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:5879:x1874187714036864:12345-0@lo:502: Request processed in 173us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364759.496950:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787364759.497015:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:5879:1874187714036864:0@lo:502: 00000020:01000000:3.0:1787364759.497037:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787364759.497047:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364759.497054:0:5879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787364759.497060:0:5879:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787364759.497063:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787364759.497076:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000056267ada) 00000020:00000080:3.0:1787364759.497093:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787364759.497097:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787364759.497167:0:5879:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787364759.497172:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2abbd 00000020:00000080:3.0:1787364759.497415:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787364759.497420:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787364759.497423:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364759.497424:0:5879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787364759.497426:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787364759.497430:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364759.497431:0:5879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787364759.497434:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787364759.497440:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c0488253) 00000020:00000080:3.0:1787364759.497635:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787364759.497643:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787364759.497644:0:5879:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787364759.497647:0:5879:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787364759.497653:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787364759.497703:0:5879:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a9b7d2b0 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787364759.497722:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000031937875) 00000020:00000080:3.0:1787364759.497731:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787364759.497773:0:5879:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787364759.497778:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2abd2 00000020:00000080:3.0:1787364759.497880:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787364759.497886:0:5879:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787364759.497890:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcfc9272e5fc2abd9 00080000:01000000:3.0:1787364759.497894:0:5879:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787364759.497897:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2abe0 00080000:10000000:3.0:1787364759.498244:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787364759.498583:0:5879:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787364759.503266:0:5879:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787364759.605943:0:5879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787364759.608189:0:5879:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787364759.614394:0:5879:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787364759.616186:0:5879:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787364759.694620:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004a504169) 00000020:00000080:2.0:1787364759.694645:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787364759.694724:0:5879:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787364759.694731:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2abee 00000020:00000080:2.0:1787364759.696612:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787364759.703299:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787364759.797595:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787364759.883561:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364759.970960:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787364760.021812:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787364760.070485:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1787364760.075098:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787364760.123267:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcfc9272e5fc2abf5 00000020:00000080:0.0:1787364760.128537:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787364760.128554:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787364760.128561:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364760.128568:0:5879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787364760.128572:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787364760.128578:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364760.128580:0:5879:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787364760.128584:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787364760.128725:0:5879:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787364760.128744:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787364760.128748:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364760.128749:0:5879:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787364760.128752:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787364760.128754:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364760.128756:0:5879:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787364760.128759:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787364760.128760:0:5879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787364760.128975:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006efae5c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:5879:1874187714036992:0@lo:502: 00000100:00100000:0.0:1787364760.129061:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364760.129117:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ef6f614 going to sleep for 11 seconds 00000100:00100000:2.0:1787364760.129180:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714036992 00000100:00100000:2.0:1787364760.129188:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714036992 00000100:00100000:2.0:1787364760.129241:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787364760.129249:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e44aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:5879:x1874187714036992:12345-0@lo:502: 00000100:00100000:0.0:1787364760.130597:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e44aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:5879:x1874187714036992:12345-0@lo:502: Request processed in 1346us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364760.130730:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006efae5c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:5879:1874187714036992:0@lo:502: 00000020:01000000:2.0:1787364760.130762:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787364760.130767:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787364760.130769:0:5879:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787364760.130773:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787364760.130915:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787364760.130935:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787364760.130949:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: 00000000861244c4/0xcfc9272e5fc2aba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364760.130960:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: 00000000861244c4/0xcfc9272e5fc2aba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364760.130968:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6d20269000 from 1 10000000:01000000:2.0:1787364760.130970:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787364760.130996:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364760.131004:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364760.131011:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364760.131026:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053583a30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037120:0@lo:101: 00000100:00100000:2.0:1787364760.131058:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364760.131089:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f612f6c going to sleep for 11 seconds 00000100:00100000:0.0:1787364760.131150:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787364760.131195:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714037120 00000100:00100000:0.0:1787364760.131201:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714037120 00000100:00100000:0.0:1787364760.131242:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787364760.131249:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec71431e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:5837:x1874187714037120:12345-0@lo:101: 00010000:00010000:0.0:1787364760.131260:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364760.131285:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2abfc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364760.131316:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364760.131337:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364760.131345:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055c3a255, rc 0) 00000100:00100000:0.0:1787364760.131374:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec71431e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:5837:x1874187714037120:12345-0@lo:101: Request processed in 126us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364760.131380:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787364760.133474:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053583a30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037120:0@lo:101: 00010000:00010000:2.0:1787364760.133501:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364760.133512:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364760.134156:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053583a30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037248:0@lo:256: 00000100:00100000:2.0:1787364760.134224:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364760.134253:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f612f6c going to sleep for 11 seconds 00000100:00100000:0.0:1787364760.134661:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714037248 00000100:00100000:0.0:1787364760.134667:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714037248 00000100:00100000:0.0:1787364760.134711:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787364760.134718:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032941dfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:5837:x1874187714037248:12345-0@lo:256: 20000000:01000000:0.0:1787364760.134735:0:5849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787364760.134740:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787364760.134858:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032941dfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:5837:x1874187714037248:12345-0@lo:256: Request processed in 140us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364760.134865:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787364760.134988:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053583a30 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037248:0@lo:256: 10000000:01000000:3.0:1787364760.135745:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787364760.135771:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.135782:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364760.135816:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d20269000 from 1 10000000:01000000:3.0:1787364760.135820:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787364760.135853:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.135861:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.135871:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364760.135888:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037376:0@lo:101: 00000100:00100000:3.0:1787364760.136167:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364760.136208:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9a0ca29 going to sleep for 11 seconds 00000100:00100000:2.0:1787364760.136539:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714037376 00000100:00100000:2.0:1787364760.136546:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714037376 00000100:00100000:2.0:1787364760.136575:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787364760.136582:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bcc7bfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:5837:x1874187714037376:12345-0@lo:101: 00010000:00010000:2.0:1787364760.136594:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364760.136621:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ac0a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364760.136643:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364760.136652:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364760.136661:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062fb272b, rc 0) 00000100:00100000:2.0:1787364760.136706:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bcc7bfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5837:x1874187714037376:12345-0@lo:101: Request processed in 124us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364760.136712:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787364760.137530:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037376:0@lo:101: 00010000:00010000:3.0:1787364760.137547:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.137556:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364760.137654:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037504:0@lo:501: 00000100:00100000:3.0:1787364760.137687:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364760.137721:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9a0ca29 going to sleep for 11 seconds 00000100:00100000:2.0:1787364760.137946:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714037504 00000100:00100000:2.0:1787364760.137956:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714037504 00000100:00100000:2.0:1787364760.137991:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787364760.137998:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015992fe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5837:x1874187714037504:12345-0@lo:501: 00000100:00100000:2.0:1787364760.139480:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015992fe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5837:x1874187714037504:12345-0@lo:501: Request processed in 1475us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364760.139493:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787364760.146192:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b29a6cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037504:0@lo:501: 00000100:00100000:0.0:1787364760.146261:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbc71a15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037632:0@lo:503: 00000100:00100000:0.0:1787364760.146614:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364760.146678:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e23cc81d going to sleep for 11 seconds 00000100:00100000:3.0:1787364760.146857:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714037632 00000100:00100000:3.0:1787364760.146865:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714037632 00000100:00100000:3.0:1787364760.146915:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787364760.146924:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006477d283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5837:x1874187714037632:12345-0@lo:503: 00000040:00080000:3.0:1787364760.146971:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787364760.147020:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006477d283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5837:x1874187714037632:12345-0@lo:503: Request processed in 98us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364760.147028:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787364760.147202:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbc71a15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037632:0@lo:503: 00000040:00080000:0.0:1787364760.148169:0:5883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787364760.148855:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787364760.148879:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787364760.150209:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.150227:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364760.150535:0:5837:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787364760.150539:0:5837:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d20269000 10000000:01000000:3.0:1787364760.150542:0:5837:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d20269000 10000000:01000000:3.0:1787364760.150545:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787364760.150551:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d20269000 from 1 10000000:01000000:3.0:1787364760.150553:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787364760.150587:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: 00000000c8848e23/0xcfc9272e5fc2ac18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.150678:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: 00000000c8848e23/0xcfc9272e5fc2ac18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.150688:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: 00000000c8848e23/0xcfc9272e5fc2ac18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364760.150711:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000313c3f20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037760:0@lo:101: 00000100:00100000:3.0:1787364760.150773:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364760.150963:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023ce5fe5 going to sleep for 11 seconds 00000100:00100000:3.0:1787364760.152520:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714037760 00000100:00100000:3.0:1787364760.152533:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714037760 00000100:00100000:3.0:1787364760.152587:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787364760.152596:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c1c01c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5837:x1874187714037760:12345-0@lo:101: 00010000:00010000:3.0:1787364760.153017:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364760.153035:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063bdbf14/0xcfc9272e5fc2ac1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ac18 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.153062:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063bdbf14/0xcfc9272e5fc2ac1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.153072:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063bdbf14/0xcfc9272e5fc2ac1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.153080:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063bdbf14, rc 0) 00000100:00100000:3.0:1787364760.153149:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c1c01c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5837:x1874187714037760:12345-0@lo:101: Request processed in 554us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364760.153156:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787364760.153242:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000313c3f20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037760:0@lo:101: 00010000:00010000:0.0:1787364760.153259:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: 00000000c8848e23/0xcfc9272e5fc2ac18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364760.153303:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: 00000000c8848e23/0xcfc9272e5fc2ac18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364760.153373:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbc71a15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037888:0@lo:501: 00000100:00100000:0.0:1787364760.153403:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364760.153437:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000973c9745 going to sleep for 11 seconds 00000100:00100000:3.0:1787364760.153590:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714037888 00000100:00100000:3.0:1787364760.153613:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714037888 00000100:00100000:3.0:1787364760.153643:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787364760.153649:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c36357b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5837:x1874187714037888:12345-0@lo:501: 00000100:00100000:3.0:1787364760.154193:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c36357b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5837:x1874187714037888:12345-0@lo:501: Request processed in 543us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364760.154201:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787364760.158517:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbc71a15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714037888:0@lo:501: 00000100:00100000:0.0:1787364760.158584:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbc71a15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714038016:0@lo:503: 00000100:00100000:0.0:1787364760.158680:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364760.158721:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000973c9745 going to sleep for 11 seconds 00000100:00100000:3.0:1787364760.158852:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714038016 00000100:00100000:3.0:1787364760.158858:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714038016 00000100:00100000:3.0:1787364760.158904:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787364760.158911:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000059c3ddd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5837:x1874187714038016:12345-0@lo:503: 00000100:00100000:3.0:1787364760.159257:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000059c3ddd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5837:x1874187714038016:12345-0@lo:503: Request processed in 346us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364760.159265:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787364760.159529:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbc71a15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714038016:0@lo:503: 00000100:00100000:1.0:1787364760.161063:0:5884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c53396b2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:5884:1874187714038144:0@lo:502: 00000100:00100000:1.0:1787364760.161131:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364760.161182:0:5884:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d279d62f going to sleep for 11 seconds 00000100:00100000:0.0:1787364760.161231:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714038144 00000100:00100000:0.0:1787364760.161238:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714038144 00000100:00100000:0.0:1787364760.161285:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787364760.161302:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068e66b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5884:x1874187714038144:12345-0@lo:502: 00000100:00100000:0.0:1787364760.161561:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068e66b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5884:x1874187714038144:12345-0@lo:502: Request processed in 269us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364760.161568:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787364760.161858:0:5884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c53396b2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:5884:1874187714038144:0@lo:502: 00000020:01000004:1.0:1787364760.161918:0:5884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787364760.161946:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004e872225) 00000020:00000080:1.0:1787364760.161970:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787364760.162055:0:5884:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a9b7d2b0 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787364760.162060:0:5884:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a9b7d2b0 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787364760.162067:0:5884:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a9b7d2b0 4 00010000:00080000:1.0:1787364760.162094:0:5884:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000618e24de@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.102@tcp at head 00010000:00010000:1.0:1787364760.165513:0:5884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787364760.165820:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787364760.165865:0:5884:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787364760.165875:0:5884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcfc9272e5fc2ac2d 00000100:00080000:1.0:1787364760.165885:0:5884:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787364760.165890:0:5884:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000618e24de using connection 192.168.204.102@tcp/0@lo 00000100:00100000:1.0:1787364760.165920:0:5884:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c53396b2 x1874187714038272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787364760.165944:0:5884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787364760.166079:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c53396b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714038272:0@lo:38: 00000100:00100000:0.0:1787364760.166142:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364760.166411:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714038272 00000100:00100000:1.0:1787364760.166418:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714038272 00000100:00100000:1.0:1787364760.166457:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787364760.166463:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbc71a15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874187714038272:12345-0@lo:38: 00000100:00100000:1.0:1787364760.166521:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbc71a15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874187714038272:12345-0@lo:38: Request processed in 57us (379us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787364760.166529:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364760.166594:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787364760.166615:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000618e24de lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787364760.166619:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787364760.166622:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c53396b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714038272:0@lo:38: 00000100:00100000:1.0:1787364760.175689:0:5884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001e97f007 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:5884:1874187714038400:0@lo:502: 00000100:00100000:1.0:1787364760.175807:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364760.175869:0:5884:0:(client.c:2715:ptlrpc_set_wait()) set 00000000604f84e1 going to sleep for 11 seconds 00000100:00100000:2.0:1787364760.175990:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714038400 00000100:00100000:2.0:1787364760.175997:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714038400 00000100:00100000:2.0:1787364760.176051:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787364760.176060:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000842e93c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5884:x1874187714038400:12345-0@lo:502: 00000100:00100000:2.0:1787364760.176414:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000842e93c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5884:x1874187714038400:12345-0@lo:502: Request processed in 355us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364760.176422:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787364760.176478:0:5884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001e97f007 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:5884:1874187714038400:0@lo:502: 00000040:00080000:2.0:1787364760.176504:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787364760.176697:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787364760.176721:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787364760.176733:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: 00000000c8848e23/0xcfc9272e5fc2ac18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364760.176744:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: 00000000c8848e23/0xcfc9272e5fc2ac18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787364760.176809:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787364760.176812:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787364760.176813:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787364760.176814:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787364760.176816:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787364760.176817:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787364760.176818:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787364760.176820:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787364760.176821:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787364760.176822:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787364760.176824:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787364760.176825:0:5837:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787364760.176828:0:5837:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787364760.176831:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787364760.176832:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787364760.176833:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787364760.176834:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787364760.176835:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787364760.176836:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787364760.176837:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787364760.176838:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787364760.176839:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787364760.176839:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787364760.176840:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787364760.176841:0:5837:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787364760.176857:0:5837:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787364760.176866:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714038528:0@lo:253: 00000100:00100000:0.0:1787364760.176899:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364760.176931:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ef6f614 going to sleep for 11 seconds 00000100:00100000:1.0:1787364760.177019:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714038528 00000100:00100000:1.0:1787364760.177024:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714038528 00000100:00100000:1.0:1787364760.177059:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787364760.177067:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017e8d3ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5837:x1874187714038528:12345-0@lo:253: 20000000:01000000:1.0:1787364760.177086:0:5849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787364760.177102:0:5849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787364760.219705:0:5849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787364760.219739:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787364760.219809:0:5872:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787364760.219814:0:5872:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787364760.219834:0:5872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.219852:0:5872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.219859:0:5872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.219897:0:5872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364760.219911:0:5872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 12 pid: 5849 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364760.219936:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f3a64ce pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874187714038656:0@lo:104: 00000100:00100000:3.0:1787364760.220001:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364760.220057:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9a0ca29 going to sleep for 11 seconds 00000100:00100000:1.0:1787364760.220127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714038656 00000100:00100000:1.0:1787364760.220133:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714038656 00000100:00100000:1.0:1787364760.220184:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787364760.220192:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064ae8844 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5872:x1874187714038656:12345-0@lo:104: 00010000:00010000:1.0:1787364760.220205:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220265:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787364760.220396:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064ae8844 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5872:x1874187714038656:12345-0@lo:104: Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364760.220405:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787364760.220428:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787364760.220433:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220441:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad778c48 already unused, calling callback (000000000ec6d7c2) 10000000:00010000:1.0:1787364760.220444:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220452:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787364760.220458:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364760.220463:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787364760.220492:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220498:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787364760.220523:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220528:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: 00000000ad778c48/0xcfc9272e5fc2abfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220545:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364760.220547:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364760.220548:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364760.220676:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714038784:0@lo:103: 00000100:00100000:1.0:1787364760.220709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364760.220826:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714038784 00000100:00100000:1.0:1787364760.220831:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714038784 00010000:00010000:1.0:1787364760.220848:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 13 pid: 5849 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364760.220869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787364760.220877:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005158cf39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3314:x1874187714038784:12345-0@lo:103: 00010000:00010000:1.0:1787364760.220886:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364760.220890:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 13 pid: 5849 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220899:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 13 pid: 5849 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220913:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220921:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787364760.220942:0:5841:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001129340s 00010000:00010000:1.0:1787364760.220946:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220952:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220957:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220962:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220967:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000e1b40b9 already unused, calling callback (00000000685e2d34) 00010000:00010000:1.0:1787364760.220969:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220975:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220983:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.220991:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364760.221020:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005158cf39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3314:x1874187714038784:12345-0@lo:103: Request processed in 144us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364760.221027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787364760.221062:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714038784:0@lo:103: 00010000:00010000:1.0:1787364760.221092:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000055c3a255/0xcfc9272e5fc2ac03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2abfc expref: 12 pid: 5849 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364760.221110:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f3a64ce pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874187714038656:0@lo:104: 00010000:00010000:1.0:1787364760.221122:0:5872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.221128:0:5872:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.221134:0:5872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364760.221138:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e1b40b9/0xcfc9272e5fc2ac34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364760.229759:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017e8d3ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5837:x1874187714038528:12345-0@lo:253: Request processed in 52685us (52850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364760.229776:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787364760.229958:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:5837:1874187714038528:0@lo:253: 10000000:01000000:0.0:1787364760.229974:0:5837:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787364760.229978:0:5837:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787364760.229979:0:5837:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787364760.229981:0:5837:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787364760.229982:0:5837:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787364760.229983:0:5837:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787364760.229984:0:5837:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787364760.229986:0:5837:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787364760.229987:0:5837:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787364760.229988:0:5837:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787364760.229990:0:5837:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787364760.229991:0:5837:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787364760.229992:0:5837:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787364760.230008:0:5837:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787364760.236207:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364760.236903:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787364760.237144:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364760.237473:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787364760.237753:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364760.238016:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787364760.239049:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364760.239259:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787364760.239595:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364760.239922:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787364760.240094:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364760.240434:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787364760.302458:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787364760.354156:0:5837:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787364760.354432:0:5889:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787364760.354447:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787364760.357260:0:5890:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787364760.363699:0:5837:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787364760.366411:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787364760.372141:0:5837:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787364760.373060:0:5837:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787364760.373659:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787364760.379882:0:5837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787364760.381418:0:5837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787364760.382765:0:5837:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787364760.388390:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787364760.394958:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787364760.402716:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787364760.404266:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787364760.404469:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787364760.404632:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787364760.404826:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787364760.404951:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787364760.405116:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787364760.405249:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787364760.405431:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787364760.405568:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787364760.405711:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787364760.405879:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787364760.406028:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787364760.406181:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787364760.406353:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787364760.406505:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787364760.408391:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787364760.408767:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787364760.410429:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787364760.410854:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787364760.411160:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787364760.413417:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787364760.416399:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787364760.416899:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787364760.419126:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787364760.426558:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787364760.426911:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787364760.427065:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787364760.427243:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787364760.427605:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787364760.427769:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787364760.427951:0:5837:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787364760.428205:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787364760.471849:0:5890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787364760.601962:0:5837:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787364760.602001:0:5837:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb71e01d87988 00100000:10000000:3.0:1787364760.602011:0:5837:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787364760.603685:0:5837:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787364760.603701:0:5837:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787364760.603714:0:5837:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787364760.603730:0:5837:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787364760.614238:0:5890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787364760.615980:0:5890:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787364760.615987:0:5890:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787364761.100087:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364762.122935:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364763.147081:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364764.172542:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364765.194961:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787364765.208108:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787364765.208120:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787364765.208124:0:37:0:(import.c:65:import_set_state_nolock()) 00000000618e24de lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787364765.208137:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000618e24de using connection 192.168.204.102@tcp/0@lo 00000100:00100000:3.0:1787364765.208159:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e26d5ccb x1874187714039040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787364765.209330:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e26d5ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714039040:0@lo:38: 00000100:00100000:3.0:1787364765.209411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364765.209534:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364765.209542:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de54b968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714038912:0@lo:400: 00000100:00100000:3.0:1787364765.209571:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364765.209632:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714038912 00000100:00100000:3.0:1787364765.209640:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714038912 00000100:00100000:3.0:1787364765.210160:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787364765.210171:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c55b759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:3316:x1874187714038912:12345-0@lo:400: 00000100:00100000:3.0:1787364765.210244:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c55b759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:3316:x1874187714038912:12345-0@lo:400: Request processed in 76us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364765.210260:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787364765.211233:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714039040 00000100:00100000:2.0:1787364765.211243:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714039040 00000100:00100000:2.0:1787364765.211279:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787364765.211285:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7840902 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1874187714039040:12345-0@lo:38: 00010000:00080000:2.0:1787364765.211310:0:5858:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1787364765.211363:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcfc9272e5fc2ac3b 00000004:00100000:2.0:1787364765.211408:0:5858:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787364765.211526:0:5858:0:(import.c:65:import_set_state_nolock()) 000000001ea36d46 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787364765.211590:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7840902 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874187714039040:12345-0@lo:38: Request processed in 304us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364765.211597:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787364765.218547:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de54b968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714038912:0@lo:400: 00010000:00080000:3.0:1787364765.218603:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e26d5ccb x1874187714039040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787364775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787364765.218620:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787364765.218629:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787364765.218634:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787364765.218637:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000618e24de lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787364765.218643:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e26d5ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714039040:0@lo:38: 00000001:02000400:3.0:1787364765.294505:0:6133:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1787364766.218921:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787364766.218930:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6d20269000 from 3 10000000:01000000:1.0:1787364766.218935:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787364766.218987:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: 00000000e9f4df8a/0xcfc9272e5fc2ac42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364766.219000:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: 00000000e9f4df8a/0xcfc9272e5fc2ac42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364766.219009:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: 00000000e9f4df8a/0xcfc9272e5fc2ac42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364766.219047:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714039168:0@lo:101: 00000100:00100000:1.0:1787364766.219140:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364766.219387:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000821cfb54 going to sleep for 11 seconds 00010000:00010000:3.0:1787364766.222202:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364766.224291:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714039168 00000100:00100000:2.0:1787364766.224305:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714039168 00000100:00100000:2.0:1787364766.224417:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787364766.224427:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007470fcde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5853:x1874187714039168:12345-0@lo:101: 00010000:00010000:2.0:1787364766.224457:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364766.224478:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003299fb4b/0xcfc9272e5fc2ac49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ac42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364766.224524:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003299fb4b/0xcfc9272e5fc2ac49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364766.224535:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003299fb4b/0xcfc9272e5fc2ac49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364766.224545:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003299fb4b, rc 0) 00000100:00100000:2.0:1787364766.224626:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007470fcde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714039168:12345-0@lo:101: Request processed in 201us (5487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364766.224634:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787364766.224724:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714039168:0@lo:101: 00010000:00010000:1.0:1787364766.224741:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: 00000000e9f4df8a/0xcfc9272e5fc2ac42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364766.224750:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: 00000000e9f4df8a/0xcfc9272e5fc2ac42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364766.224832:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714039296:0@lo:256: 00000100:00100000:1.0:1787364766.224866:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364766.228407:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000821cfb54 going to sleep for 11 seconds 00000100:00100000:3.0:1787364766.232603:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714039296 00000100:00100000:3.0:1787364766.232618:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714039296 00000100:00100000:1.0:1787364766.234370:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787364766.234381:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083c2f1f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714039296:12345-0@lo:256: 20000000:01000000:1.0:1787364766.234407:0:5851:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787364766.234430:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787364766.234432:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787364766.234587:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083c2f1f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714039296:12345-0@lo:256: Request processed in 207us (9720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364766.234595:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787364766.234630:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714039296:0@lo:256: 10000000:01000000:1.0:1787364766.234809:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787364766.234819:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: 00000000e9f4df8a/0xcfc9272e5fc2ac42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364766.234829:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: 00000000e9f4df8a/0xcfc9272e5fc2ac42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364767.242983:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364768.267820:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364769.290954:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364770.322163:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714039424:0@lo:400: 00000100:00100000:0.0:1787364770.322244:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364770.322313:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787364770.322320:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000104cf160 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714039552:0@lo:400: 00000100:00100000:0.0:1787364770.322350:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364770.322384:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714039424 00000100:00100000:0.0:1787364770.322390:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714039424 00000100:00100000:0.0:1787364770.322432:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787364770.322439:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000444cc752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:3316:x1874187714039424:12345-0@lo:400: 00000100:00100000:0.0:1787364770.322487:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000444cc752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:3316:x1874187714039424:12345-0@lo:400: Request processed in 48us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364770.322494:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787364770.322543:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714039552 00000100:00100000:0.0:1787364770.322547:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714039552 00000100:00100000:0.0:1787364770.322568:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364770.322573:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ce36563 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714039552:12345-0@lo:400: 00000100:00100000:0.0:1787364770.322605:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ce36563 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714039552:12345-0@lo:400: Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364770.322611:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787364770.322641:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000104cf160 x1874187714039552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364770.322655:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000104cf160 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714039552:0@lo:400: 00000100:00100000:0.0:1787364770.322680:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714039424:0@lo:400: 00010000:00010000:1.0:1787364770.323148:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787364770.813623:0:6336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbb8273e0 20000000:00000080:0.0:1787364770.813642:0:6336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d40d21800 uarg=0000000000000000 20000000:01000000:0.0:1787364770.813673:0:6336:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787364770.813681:0:6336:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787364770.813686:0:6336:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787364770.814289:0:6336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787364770.814299:0:6336:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787364770.820688:0:6336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787364770.821582:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787364770.821654:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787364770.821723:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787364770.821741:0:6336:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787364770.821758:0:6336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364770.821930:0:6336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364770.821939:0:6336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364770.822031:0:6336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364770.822046:0:6336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 11 pid: 5851 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364770.822060:0:6336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6336:1874187714039680:0@lo:104: 00000100:00100000:1.0:1787364770.822190:0:6336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364770.822286:0:6336:0:(client.c:2715:ptlrpc_set_wait()) set 00000000874e39c5 going to sleep for 11 seconds 00000100:00100000:3.0:1787364770.822346:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714039680 00000100:00100000:3.0:1787364770.822352:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714039680 00000100:00100000:3.0:1787364770.822440:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787364770.822448:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2543a19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:6336:x1874187714039680:12345-0@lo:104: 00010000:00010000:3.0:1787364770.822460:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364770.822538:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787364770.822543:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2543a19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:6336:x1874187714039680:12345-0@lo:104: Request processed in 98us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364770.822550:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787364770.822597:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364770.822602:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822610:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d6f67b5d already unused, calling callback (000000000ec6d7c2) 10000000:00010000:0.0:1787364770.822612:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822619:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364770.822636:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364770.822642:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787364770.822672:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822678:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364770.822692:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822698:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: 00000000d6f67b5d/0xcfc9272e5fc2ac0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822716:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364770.822717:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364770.822719:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364770.822737:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714039808:0@lo:103: 00000100:00100000:0.0:1787364770.822768:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364770.822838:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714039808 00000100:00100000:0.0:1787364770.822843:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714039808 00010000:00010000:0.0:1787364770.822859:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 12 pid: 5851 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364770.822879:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364770.822885:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000104cf160 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:3314:x1874187714039808:12345-0@lo:103: 00010000:00010000:0.0:1787364770.822895:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364770.822899:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 12 pid: 5851 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822928:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 12 pid: 5851 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822950:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822963:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822981:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822988:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822993:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.822999:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.823011:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f18c90c already unused, calling callback (00000000685e2d34) 00010000:00010000:0.0:1787364770.823014:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.823021:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.823029:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364770.823083:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364770.823159:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000104cf160 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:3314:x1874187714039808:12345-0@lo:103: Request processed in 274us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364770.823167:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364770.823212:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714039808:0@lo:103: 00010000:00010000:1.0:1787364770.823362:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000062fb272b/0xcfc9272e5fc2ac11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac0a expref: 11 pid: 5851 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364770.823380:0:6336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6336:1874187714039680:0@lo:104: 00010000:00010000:1.0:1787364770.823393:0:6336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364770.823407:0:6336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364770.823412:0:6336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364770.823417:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003f18c90c/0xcfc9272e5fc2ac50 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364771.338933:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364772.363987:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364773.388227:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364774.418252:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364775.441460:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364775.441555:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714039936:0@lo:400: 00000100:00100000:0.0:1787364775.441624:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364775.441673:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787364775.441679:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be65e71f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714040064:0@lo:400: 00000100:00100000:0.0:1787364775.441704:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364775.441736:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714039936 00000100:00100000:0.0:1787364775.441742:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714039936 00000100:00100000:0.0:1787364775.441805:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787364775.441815:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc4eb8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:3315:x1874187714039936:12345-0@lo:400: 00000100:00100000:0.0:1787364775.441862:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc4eb8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:3315:x1874187714039936:12345-0@lo:400: Request processed in 50us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364775.441869:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787364775.441903:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714040064 00000100:00100000:0.0:1787364775.441907:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714040064 00000100:00100000:0.0:1787364775.441932:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364775.441938:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065b0b842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714040064:12345-0@lo:400: 00000100:00100000:0.0:1787364775.441967:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065b0b842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714040064:12345-0@lo:400: Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364775.442013:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787364775.442054:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000be65e71f x1874187714040064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364775.442070:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be65e71f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714040064:0@lo:400: 00000100:00100000:0.0:1787364775.442081:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714039936:0@lo:400: 10000000:01000000:1.0:1787364775.442221:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787364775.442226:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d20269000 from 1 10000000:01000000:1.0:1787364775.442229:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787364775.442257:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: 0000000021f40a9f/0xcfc9272e5fc2ac57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364775.442266:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: 0000000021f40a9f/0xcfc9272e5fc2ac57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364775.442275:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: 0000000021f40a9f/0xcfc9272e5fc2ac57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364775.442289:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714040192:0@lo:101: 00000100:00100000:1.0:1787364775.442329:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364775.442357:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 000000007da554ea going to sleep for 11 seconds 00000100:00100000:0.0:1787364775.443022:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714040192 00000100:00100000:0.0:1787364775.443028:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714040192 00000100:00100000:0.0:1787364775.443064:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787364775.443071:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d26997e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:5853:x1874187714040192:12345-0@lo:101: 00010000:00010000:0.0:1787364775.443081:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364775.443095:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a986332/0xcfc9272e5fc2ac5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ac57 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364775.443116:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a986332/0xcfc9272e5fc2ac5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364775.443126:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a986332/0xcfc9272e5fc2ac5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364775.443135:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a986332, rc 0) 00000100:00100000:0.0:1787364775.443176:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d26997e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714040192:12345-0@lo:101: Request processed in 106us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364775.443183:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787364775.443226:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a34ac81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714040192:0@lo:101: 00010000:00010000:0.0:1787364775.443238:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: 0000000021f40a9f/0xcfc9272e5fc2ac57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364775.443259:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: 0000000021f40a9f/0xcfc9272e5fc2ac57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364775.443311:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714040320:0@lo:501: 00000100:00100000:0.0:1787364775.443348:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364775.443362:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042516c63 going to sleep for 11 seconds 00000100:00100000:0.0:1787364775.443375:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714040320 00000100:00100000:0.0:1787364775.443378:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714040320 00000100:00100000:0.0:1787364775.443401:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787364775.443407:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096e9581f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714040320:12345-0@lo:501: 00000100:00100000:0.0:1787364775.443641:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096e9581f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714040320:12345-0@lo:501: Request processed in 234us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364775.443648:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787364775.443677:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714040320:0@lo:501: 00000100:00100000:0.0:1787364775.443702:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714040448:0@lo:503: 00000100:00100000:0.0:1787364775.443737:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364775.443750:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042516c63 going to sleep for 11 seconds 00000100:00100000:0.0:1787364775.443760:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714040448 00000100:00100000:0.0:1787364775.443763:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714040448 00000100:00100000:0.0:1787364775.443803:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787364775.443809:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eecaa603 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714040448:12345-0@lo:503: 00000100:00100000:0.0:1787364775.443980:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eecaa603 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714040448:12345-0@lo:503: Request processed in 171us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364775.443987:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787364775.444033:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714040448:0@lo:503: 00000100:00100000:0.0:1787364775.446145:0:6608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6608:1874187714040576:0@lo:502: 00000100:00100000:0.0:1787364775.446277:0:6608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364775.447163:0:6608:0:(client.c:2715:ptlrpc_set_wait()) set 0000000006e2f830 going to sleep for 11 seconds 00000100:00100000:1.0:1787364775.452632:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714040576 00000100:00100000:1.0:1787364775.452646:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714040576 00000100:00100000:0.0:1787364775.452774:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787364775.452819:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008576edcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6608:x1874187714040576:12345-0@lo:502: 00000100:00100000:0.0:1787364775.453159:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008576edcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6608:x1874187714040576:12345-0@lo:502: Request processed in 376us (6881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364775.453168:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787364775.453195:0:6608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcc49a2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6608:1874187714040576:0@lo:502: 00000020:01000000:3.0:1787364775.453229:0:6608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787364775.453240:0:6608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364775.453242:0:6608:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787364775.453249:0:6608:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d20269000 00000020:00000080:3.0:1787364775.453251:0:6608:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787364775.453304:0:6608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6608:1874187714040704:0@lo:502: 00000100:00100000:3.0:1787364775.453347:0:6608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364775.453381:0:6608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364775.453450:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714040704 00000100:00100000:0.0:1787364775.453465:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714040704 00000100:00100000:0.0:1787364775.453498:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787364775.453506:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6608:x1874187714040704:12345-0@lo:502: 00000100:00100000:0.0:1787364775.453627:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6608:x1874187714040704:12345-0@lo:502: Request processed in 121us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364775.453634:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787364775.453832:0:6608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6608:1874187714040704:0@lo:502: 00000020:01000000:3.0:1787364775.453854:0:6608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787364775.453859:0:6608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364775.453861:0:6608:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787364775.453865:0:6608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787364775.456002:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787364775.456034:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787364775.456045:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364775.456058:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364776.458960:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364777.485301:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787364777.897190:0:6705:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787364777.897194:0:6705:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787364777.897338:0:6705:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b6d055cd000 00000020:01000004:0.0:1787364777.897355:0:6705:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787364777.897367:0:6705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787364777.897381:0:6705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b6d04f50000) 00000020:00000080:0.0:1787364777.897397:0:6705:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787364777.912057:0:6705:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787364777.912304:0:6705:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787364777.934855:0:6705:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787364777.941608:0:6705:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787364777.941642:0:6705:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787364777.941700:0:6705:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787364777.941743:0:6705:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787364777.942276:0:6705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787364777.942289:0:6705:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787364777.942299:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcfc9272e5fc2ac6c 00000020:01000004:3.0:1787364777.942307:0:6705:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787364777.942461:0:6705:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787364777.942467:0:6705:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787364777.942474:0:6705:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787364777.942486:0:6705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787364777.942501:0:6705:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b6d34484d28) 00000020:00000080:3.0:1787364777.942516:0:6705:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787364777.944190:0:6705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787364777.944399:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787364777.944405:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787364777.947831:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787364777.947847:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787364777.948463:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787364777.948479:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787364777.950296:0:6705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787364777.950538:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787364777.950542:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787364777.958698:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787364777.958711:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787364777.995166:0:6705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787364777.995585:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787364777.995593:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787364778.001335:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787364778.010872:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787364778.012583:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787364778.012597:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787364778.017184:0:6705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787364778.017417:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787364778.017425:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787364778.018434:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787364778.018449:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787364778.074399:0:6705:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787364778.074587:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787364778.074593:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787364778.075737:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787364778.075746:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787364778.076517:0:6705:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787364778.076542:0:6705:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787364778.076549:0:6705:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787364778.103540:0:6705:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787364778.103580:0:6705:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.102@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787364778.103584:0:6705:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787364778.103585:0:6705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787364778.103587:0:6705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787364778.103588:0:6705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787364778.103589:0:6705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787364778.103591:0:6705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787364778.103592:0:6705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787364778.103593:0:6705:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787364778.103595:0:6705:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787364778.103596:0:6705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787364778.103597:0:6705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787364778.103600:0:6705:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787364778.103602:0:6705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787364778.103603:0:6705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787364778.103604:0:6705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787364778.103606:0:6705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787364778.103610:0:6705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787364778.103611:0:6705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787364778.103612:0:6705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787364778.103613:0:6705:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787364778.103614:0:6705:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787364778.103615:0:6705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787364778.103616:0:6705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787364778.103641:0:6705:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787364778.103658:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714040832:0@lo:253: 00000100:00100000:3.0:1787364778.104076:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.104163:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d202aa600 going to sleep for 11 seconds 00000100:00100000:0.0:1787364778.104284:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714040832 00000100:00100000:0.0:1787364778.104291:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714040832 00000100:00100000:0.0:1787364778.104391:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787364778.104402:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714040832:12345-0@lo:253: 20000000:01000000:0.0:1787364778.104437:0:5850:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787364778.104441:0:5850:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787364778.104446:0:5850:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787364778.104450:0:5850:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787364778.105340:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787364778.105530:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787364778.105544:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787364778.105576:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787364778.105583:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787364778.105611:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787364778.105658:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787364778.105973:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787364778.105993:0:5850:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.102@tcp 20000000:01000000:0.0:1787364778.105995:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.102@tcp (null) (null) (null) 00000040:00080000:0.0:1787364778.106027:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787364778.106035:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787364778.106096:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787364778.106104:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.102@tcp (null) (null) 00000040:00080000:0.0:1787364778.106139:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787364778.106148:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787364778.106176:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787364778.106224:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787364778.107142:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787364778.107161:0:5850:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.102@tcp 20000000:01000000:0.0:1787364778.107163:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.102@tcp (null) (null) (null) 00000040:00080000:0.0:1787364778.107198:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787364778.107206:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787364778.107250:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787364778.107258:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.102@tcp (null) (null) 00000040:00080000:0.0:1787364778.107303:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787364778.107313:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787364778.107346:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787364778.107468:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787364778.107486:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787364778.107489:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787364778.107495:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787364778.107497:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787364778.107499:0:5850:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787364778.107511:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787364778.107513:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787364778.107550:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787364778.107553:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787364778.108192:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787364778.108493:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787364778.108535:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787364778.108594:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787364778.108607:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787364778.108609:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787364778.109245:0:6721:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787364778.109315:0:6721:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787364778.109361:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787364778.109609:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787364778.109645:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787364778.109678:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787364778.109687:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787364778.109690:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787364778.110359:0:6722:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787364778.110402:0:6722:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787364778.110445:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787364778.110661:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787364778.110939:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787364778.111015:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1787364778.111034:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787364778.111054:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.111072:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2ab93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.111087:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2abaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.111095:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2ac1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.111103:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.111142:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2ac1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.111156:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2ac1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 12 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364778.111171:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874187714040960:0@lo:104: 00000100:00100000:0.0:1787364778.111242:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787364778.111350:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2abaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.111359:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2abaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 12 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364778.111368:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f03100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874187714041088:0@lo:104: 00000100:00100000:0.0:1787364778.111390:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787364778.111606:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2ab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.111615:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2ab93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 12 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364778.111629:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f03480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874187714041216:0@lo:104: 00000100:00100000:0.0:1787364778.111652:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.111916:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714040960 00000100:00100000:3.0:1787364778.111932:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714040960 00000100:00100000:3.0:1787364778.111980:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714041088 00000100:00100000:3.0:1787364778.111983:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714041088 00000100:00100000:3.0:1787364778.111997:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787364778.112006:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:5850:x1874187714040960:12345-0@lo:104: 00010000:00010000:3.0:1787364778.112018:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d28334600/0xcfc9272e5fc2ac18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.112080:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787364778.112086:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:5850:x1874187714040960:12345-0@lo:104: Request processed in 82us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364778.112094:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787364778.112111:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787364778.112117:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5850:x1874187714041088:12345-0@lo:104: 00010000:00010000:3.0:1787364778.112124:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2aba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.112160:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787364778.112166:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5850:x1874187714041088:12345-0@lo:104: Request processed in 50us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364778.112179:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787364778.112298:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787364778.112306:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d28334600/0xcfc9272e5fc2ac18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112313:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334600 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787364778.112317:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334600/0xcfc9272e5fc2ac18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112325:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d28334600/0xcfc9272e5fc2ac18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787364778.112332:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334600/0xcfc9272e5fc2ac18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364778.112338:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787364778.112373:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d28334600/0xcfc9272e5fc2ac18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112380:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787364778.112397:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d28334600/0xcfc9272e5fc2ac18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112403:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d28334600/0xcfc9272e5fc2ac18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112417:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787364778.112420:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2aba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112426:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c9c00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787364778.112434:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2aba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112441:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2aba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787364778.112448:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2aba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364778.112452:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787364778.112465:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2aba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112471:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787364778.112476:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2aba8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112482:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2aba8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2abaf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.112492:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364778.112494:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364778.112495:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364778.112611:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364778.112624:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714041344:0@lo:103: 00000100:00100000:0.0:1787364778.112654:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364778.112731:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364778.112737:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714041472:0@lo:103: 00000100:00100000:0.0:1787364778.112759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.112810:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714041216 00000100:00100000:3.0:1787364778.112814:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714041216 00000100:00100000:3.0:1787364778.112833:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787364778.112838:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5850:x1874187714041216:12345-0@lo:104: 00010000:00010000:3.0:1787364778.112846:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ab8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.112894:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787364778.112899:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5850:x1874187714041216:12345-0@lo:104: Request processed in 61us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364778.112906:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787364778.112929:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787364778.112934:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ab8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.112940:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364778.112952:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ab8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.112959:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ab8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364778.112965:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ab8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364778.112971:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364778.112991:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ab8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.113006:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364778.113022:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ab8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.113028:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ab8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ab93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.113043:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364778.113044:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364778.113046:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364778.113368:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714041600:0@lo:103: 00000100:00100000:0.0:1787364778.113395:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.113418:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714041344 00000100:00100000:1.0:1787364778.113422:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714041344 00010000:00010000:1.0:1787364778.113444:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2ac1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 13 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364778.113479:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714041472 00000100:00100000:2.0:1787364778.113483:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714041472 00010000:00010000:2.0:1787364778.113505:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2abaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 14 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364778.113534:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787364778.113541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:3313:x1874187714041344:12345-0@lo:103: 00010000:00010000:2.0:1787364778.113551:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364778.113557:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2ac1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 14 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.113568:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2ac1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 14 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.113584:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364778.113618:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:3313:x1874187714041344:12345-0@lo:103: Request processed in 78us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364778.113625:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787364778.113639:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787364778.113645:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3313:x1874187714041472:12345-0@lo:103: 00010000:00010000:2.0:1787364778.113653:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364778.113657:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2abaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 13 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.113665:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2abaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 13 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.113675:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364778.113697:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3313:x1874187714041472:12345-0@lo:103: Request processed in 53us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364778.113716:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787364778.113760:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714041472:0@lo:103: 00000100:00100000:2.0:1787364778.113770:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714041344:0@lo:103: 00000100:00100000:0.0:1787364778.114044:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02e15900 going to sleep for 11 seconds 00010000:00010000:0.0:1787364778.114058:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2ac1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac18 expref: 12 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364778.114069:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874187714040960:0@lo:104: 00010000:00010000:0.0:1787364778.114077:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2abaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2aba8 expref: 11 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364778.114087:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f03100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874187714041088:0@lo:104: 00000100:00100000:0.0:1787364778.114095:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f03480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5850:1874187714041216:0@lo:104: 00010000:00010000:0.0:1787364778.114111:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364778.114156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714041600 00000100:00100000:2.0:1787364778.114161:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714041600 00010000:00010000:2.0:1787364778.114176:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2ab93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 11 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364778.114202:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787364778.114209:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:3315:x1874187714041600:12345-0@lo:103: 00010000:00010000:2.0:1787364778.114216:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364778.114220:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2ab93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 11 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114228:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2ab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 11 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114238:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2ab93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ab8c expref: 11 pid: 5850 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114249:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114257:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114271:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114278:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114295:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114302:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114308:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364778.114312:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114319:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114340:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.114350:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364778.114383:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:3315:x1874187714041600:12345-0@lo:103: Request processed in 174us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364778.114389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787364778.114411:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714041600:0@lo:103: 00010000:00010000:0.0:1787364778.114482:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.114499:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.114506:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac7a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787364778.114518:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787364778.161497:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:6705:x1874187714040832:12345-0@lo:253: Request processed in 57089us (57414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364778.161512:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787364778.165192:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714040832:0@lo:253: 10000000:01000000:3.0:1787364778.165288:0:6705:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787364778.165293:0:6705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787364778.165295:0:6705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787364778.165296:0:6705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787364778.165297:0:6705:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787364778.165299:0:6705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787364778.165300:0:6705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787364778.165302:0:6705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787364778.165303:0:6705:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787364778.165305:0:6705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787364778.165306:0:6705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787364778.165333:0:6705:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d055cd000 from lustre-OST0000 10000000:01000000:3.0:1787364778.165362:0:6705:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787364778.165365:0:6705:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787364778.165373:0:6705:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6d04f519b8 local copy 10000000:01000000:3.0:1787364778.165377:0:6705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787364778.165417:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.165430:0:6705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.165455:0:6705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364778.165474:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714041728:0@lo:101: 00000100:00100000:3.0:1787364778.165543:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.165686:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c01085e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364778.165782:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714041728 00000100:00100000:0.0:1787364778.165812:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714041728 00000100:00100000:0.0:1787364778.165857:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787364778.165867:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:6705:x1874187714041728:12345-0@lo:101: 00010000:00010000:0.0:1787364778.165882:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364778.165895:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ac81 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.165918:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac81 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.166072:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac81 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.166081:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030e00, rc 0) 00000100:00100000:0.0:1787364778.166129:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:6705:x1874187714041728:12345-0@lo:101: Request processed in 263us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.166136:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787364778.168165:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714041728:0@lo:101: 00010000:00010000:3.0:1787364778.168197:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.168221:0:6705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364778.168390:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714041856:0@lo:501: 00000100:00100000:3.0:1787364778.168450:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364778.169468:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714041856 00000100:00100000:2.0:1787364778.169480:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714041856 00000100:00100000:2.0:1787364778.169541:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787364778.169551:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:6705:x1874187714041856:12345-0@lo:501: 00000100:00100000:2.0:1787364778.169851:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:6705:x1874187714041856:12345-0@lo:501: Request processed in 301us (1400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787364778.169859:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787364778.172120:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c01085e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787364778.172161:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714041856:0@lo:501: 10000000:01000000:3.0:1787364778.172184:0:6705:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787364778.173154:0:6705:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787364778.173165:0:6705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.173178:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.173185:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.173336:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787364778.173362:0:6705:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d055cd000 10000000:01000000:3.0:1787364778.173368:0:6705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787364778.173374:0:6705:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b6d04f519b8 10000000:01000000:3.0:1787364778.173376:0:6705:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787364778.173380:0:6705:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b6d04f519b8 from 1 10000000:01000000:3.0:1787364778.173382:0:6705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787364778.173418:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.173427:0:6705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.173437:0:6705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364778.173458:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714041984:0@lo:101: 00000100:00100000:3.0:1787364778.173519:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.173625:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c01085900 going to sleep for 11 seconds 00010000:00010000:0.0:1787364778.173695:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364778.173703:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.173723:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364778.173728:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.173737:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364778.173744:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364778.173751:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787364778.173771:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.173778:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364778.173827:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.173835:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d28334e00/0xcfc9272e5fc2ac81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfc9272e5fc2ac88 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.173851:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364778.173853:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364778.173854:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364778.174975:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714042112:0@lo:103: 00000100:00100000:2.0:1787364778.175030:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364778.175187:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714042112 00000100:00100000:0.0:1787364778.175194:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714042112 00000100:00100000:0.0:1787364778.175264:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364778.175275:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:3316:x1874187714042112:12345-0@lo:103: 00010000:00010000:0.0:1787364778.175288:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364778.175314:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00030e00/0xcfc9272e5fc2ac88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac81 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.175331:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364778.175371:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:3316:x1874187714042112:12345-0@lo:103: Request processed in 98us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.175379:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364778.175416:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714042112:0@lo:103: 00000100:00100000:1.0:1787364778.177462:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714041984 00000100:00100000:1.0:1787364778.177475:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714041984 00000100:00100000:0.0:1787364778.179411:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787364778.179426:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:6705:x1874187714041984:12345-0@lo:101: 00010000:00010000:0.0:1787364778.179445:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364778.179465:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00031e00/0xcfc9272e5fc2ac96 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ac8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.179494:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00031e00/0xcfc9272e5fc2ac96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac8f expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.179506:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00031e00/0xcfc9272e5fc2ac96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac8f expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.179515:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031e00, rc 0) 00000100:00100000:0.0:1787364778.179588:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:6705:x1874187714041984:12345-0@lo:101: Request processed in 165us (6069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.179596:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787364778.179838:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714041984:0@lo:101: 00010000:00010000:1.0:1787364778.179856:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac96 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.179881:0:6705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ac96 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364778.179903:0:6705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787364778.179930:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac96 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.179939:0:6705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ac96 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364778.179958:0:6705:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787364778.179963:0:6705:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787364778.179969:0:6705:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787364778.179972:0:6705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787364778.179997:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.180005:0:6705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.180013:0:6705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364778.180032:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042240:0@lo:101: 00000100:00100000:1.0:1787364778.180067:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.180352:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787364778.181675:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714042240 00000100:00100000:2.0:1787364778.181686:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714042240 00000100:00100000:2.0:1787364778.181797:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787364778.181807:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+10:6705:x1874187714042240:12345-0@lo:101: 00010000:00010000:2.0:1787364778.181822:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364778.181841:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ac9d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.181864:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.181874:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.181883:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c9c00, rc 0) 00000100:00100000:2.0:1787364778.182027:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042240:12345-0@lo:101: Request processed in 222us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364778.182035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787364778.185331:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042240:0@lo:101: 00010000:00010000:1.0:1787364778.185363:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.185391:0:6705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364778.185528:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042368:0@lo:501: 00000100:00100000:1.0:1787364778.185585:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.189808:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787364778.190380:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714042368 00000100:00100000:0.0:1787364778.190390:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714042368 00000100:00100000:0.0:1787364778.190438:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787364778.190448:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042368:12345-0@lo:501: 00000100:00100000:0.0:1787364778.190746:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042368:12345-0@lo:501: Request processed in 299us (5160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.190754:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787364778.192111:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042368:0@lo:501: 00000100:00100000:1.0:1787364778.192170:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042496:0@lo:503: 00000100:00100000:1.0:1787364778.192318:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.192357:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787364778.193120:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714042496 00000100:00100000:0.0:1787364778.193127:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714042496 00000100:00100000:0.0:1787364778.193186:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787364778.193195:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042496:12345-0@lo:503: 00000100:00100000:0.0:1787364778.193410:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042496:12345-0@lo:503: Request processed in 216us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.193418:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787364778.194054:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042496:0@lo:503: 00000040:00080000:1.0:1787364778.195451:0:6705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787364778.195540:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042624:0@lo:502: 00000100:00100000:1.0:1787364778.195607:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.195650:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787364778.195825:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714042624 00000100:00100000:2.0:1787364778.195832:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714042624 00000100:00100000:2.0:1787364778.195873:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787364778.195882:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042624:12345-0@lo:502: 00000100:00100000:2.0:1787364778.196345:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042624:12345-0@lo:502: Request processed in 463us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364778.196359:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787364778.196457:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042624:0@lo:502: 00000040:00080000:1.0:1787364778.196718:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787364778.196764:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787364778.198139:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787364778.198323:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787364778.198365:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787364778.198396:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787364778.198441:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042752:0@lo:502: 00000100:00100000:1.0:1787364778.198514:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.198625:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787364778.203883:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714042752 00000100:00100000:3.0:1787364778.203899:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714042752 00000100:00100000:3.0:1787364778.204162:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787364778.204174:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042752:12345-0@lo:502: 00000100:00100000:3.0:1787364778.204468:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042752:12345-0@lo:502: Request processed in 296us (5953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364778.204478:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787364778.204585:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042752:0@lo:502: 00000040:00080000:1.0:1787364778.204739:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787364778.204754:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787364778.208485:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787364778.208498:0:6724:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787364778.208505:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364778.208507:0:6724:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787364778.208513:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787364778.208531:0:6724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b6d3ff599b8) 00000020:00000080:1.0:1787364778.208553:0:6724:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787364778.208560:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787364778.208619:0:6724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d055cd000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787364778.208627:0:6724:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787364778.208633:0:6724:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcfc9272e5fc2acb2 00010000:00010000:2.0:1787364778.222225:0:6724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787364778.222553:0:6724:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787364778.224741:0:6724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787364778.228553:0:6724:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787364778.246585:0:6724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787364778.247435:0:6724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787364778.260239:0:6724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787364778.260251:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787364778.260258:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364778.260260:0:6724:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787364778.260263:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787364778.260268:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364778.260269:0:6724:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787364778.260272:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787364778.260274:0:6724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787364778.260347:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787364778.260351:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364778.260352:0:6724:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787364778.260356:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787364778.260580:0:6705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787364778.260605:0:6705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787364778.260627:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.260639:0:6705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364778.260648:0:6705:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d055cd000 from 1 10000000:01000000:2.0:1787364778.260650:0:6705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787364778.260689:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.260697:0:6705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.260708:0:6705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364778.260733:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042880:0@lo:101: 00000100:00100000:2.0:1787364778.260833:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364778.260895:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26480 going to sleep for 11 seconds 00000100:00100000:1.0:1787364778.261090:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714042880 00000100:00100000:1.0:1787364778.261098:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714042880 00000100:00100000:1.0:1787364778.261145:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787364778.261154:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:6705:x1874187714042880:12345-0@lo:101: 00010000:00010000:1.0:1787364778.261169:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364778.261183:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2acb9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.261218:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.261229:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.261237:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0400, rc 0) 00000100:00100000:1.0:1787364778.261278:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714042880:12345-0@lo:101: Request processed in 125us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364778.261296:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787364778.261444:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714042880:0@lo:101: 00010000:00010000:2.0:1787364778.261458:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.261473:0:6705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364778.261568:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043008:0@lo:501: 00000100:00100000:2.0:1787364778.261597:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.263162:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26480 going to sleep for 11 seconds 00000100:00100000:1.0:1787364778.269509:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714043008 00000100:00100000:1.0:1787364778.269524:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714043008 00000100:00100000:1.0:1787364778.269584:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787364778.269594:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043008:12345-0@lo:501: 00000100:00100000:1.0:1787364778.269906:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043008:12345-0@lo:501: Request processed in 313us (8307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364778.269914:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787364778.269994:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043008:0@lo:501: 00000100:00100000:1.0:1787364778.270043:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043136:0@lo:503: 00000100:00100000:1.0:1787364778.270086:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.270115:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787364778.270134:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714043136 00000100:00100000:1.0:1787364778.270138:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714043136 00000100:00100000:1.0:1787364778.270160:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787364778.270165:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043136:12345-0@lo:503: 00000100:00100000:1.0:1787364778.270320:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043136:12345-0@lo:503: Request processed in 153us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364778.270327:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787364778.270366:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043136:0@lo:503: 00000040:00080000:1.0:1787364778.270618:0:6705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787364778.270676:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043264:0@lo:502: 00000100:00100000:1.0:1787364778.270711:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.270727:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787364778.270742:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714043264 00000100:00100000:1.0:1787364778.270752:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714043264 00000100:00100000:1.0:1787364778.270773:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787364778.270779:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043264:12345-0@lo:502: 00000100:00100000:1.0:1787364778.270961:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043264:12345-0@lo:502: Request processed in 180us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364778.270968:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787364778.271006:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043264:0@lo:502: 00000040:00080000:1.0:1787364778.271244:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787364778.271290:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787364778.271312:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043392:0@lo:502: 00000100:00100000:1.0:1787364778.271345:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.271361:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787364778.271374:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714043392 00000100:00100000:1.0:1787364778.271378:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714043392 00000100:00100000:1.0:1787364778.271400:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787364778.271407:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043392:12345-0@lo:502: 00000100:00100000:1.0:1787364778.271517:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043392:12345-0@lo:502: Request processed in 110us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364778.271523:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787364778.271562:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043392:0@lo:502: 00000040:00080000:1.0:1787364778.271631:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787364778.271639:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787364778.271952:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787364778.271961:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364778.271963:0:6728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787364778.271969:0:6728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d055cd000 00000020:00000080:1.0:1787364778.271972:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787364778.272000:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787364778.272003:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364778.272005:0:6728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787364778.272008:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787364778.272034:0:6705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787364778.272051:0:6705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787364778.272067:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.272076:0:6705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364778.272110:0:6705:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787364778.272113:0:6705:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d055cd000 10000000:01000000:1.0:1787364778.272116:0:6705:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d055cd000 10000000:01000000:1.0:1787364778.272121:0:6705:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787364778.272126:0:6705:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d055cd000 from 1 10000000:01000000:1.0:1787364778.272129:0:6705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787364778.272157:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.272165:0:6705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.272175:0:6705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364778.272189:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043520:0@lo:101: 00000100:00100000:1.0:1787364778.272221:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.272238:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787364778.272252:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714043520 00000100:00100000:1.0:1787364778.272262:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714043520 00000100:00100000:1.0:1787364778.272286:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787364778.272293:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714043520:12345-0@lo:101: 00010000:00010000:1.0:1787364778.280042:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364778.280092:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2acc7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.280133:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.280147:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.280158:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0a00, rc 0) 00000100:00100000:1.0:1787364778.280300:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714043520:12345-0@lo:101: Request processed in 8006us (8077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364778.280309:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787364778.284075:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043520:0@lo:101: 00010000:00010000:2.0:1787364778.284108:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364778.284122:0:6705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364778.288060:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043648:0@lo:501: 00000100:00100000:3.0:1787364778.288134:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.288230:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c01085600 going to sleep for 11 seconds 00000100:00100000:0.0:1787364778.290909:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714043648 00000100:00100000:0.0:1787364778.290930:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714043648 00000100:00100000:0.0:1787364778.290998:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787364778.291008:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714043648:12345-0@lo:501: 00000100:00100000:0.0:1787364778.291369:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714043648:12345-0@lo:501: Request processed in 362us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.291378:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787364778.294061:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043648:0@lo:501: 00000100:00100000:0.0:1787364778.294458:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043776:0@lo:503: 00000100:00100000:0.0:1787364778.294530:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364778.294577:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364778.294629:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714043776 00000100:00100000:1.0:1787364778.294635:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714043776 00000100:00100000:1.0:1787364778.294781:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787364778.294820:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714043776:12345-0@lo:503: 00000100:00100000:1.0:1787364778.295035:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714043776:12345-0@lo:503: Request processed in 217us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364778.295043:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787364778.295125:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043776:0@lo:503: 00000040:00080000:2.0:1787364778.295397:0:6705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787364778.295459:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043904:0@lo:502: 00000100:00100000:2.0:1787364778.295498:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364778.305892:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26000 going to sleep for 11 seconds 00000100:00100000:0.0:1787364778.307567:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714043904 00000100:00100000:0.0:1787364778.307581:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714043904 00000100:00100000:0.0:1787364778.307636:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787364778.307647:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714043904:12345-0@lo:502: 00000100:00100000:0.0:1787364778.308155:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714043904:12345-0@lo:502: Request processed in 508us (12654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.308174:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787364778.311338:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714043904:0@lo:502: 00000040:00080000:2.0:1787364778.311682:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787364778.311742:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787364778.311774:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787364778.313030:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787364778.313079:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787364778.313129:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787364778.313188:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787364778.313220:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787364778.313270:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787364778.313307:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787364778.313342:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787364778.313386:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787364778.313417:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787364778.313446:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787364778.313491:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787364778.313527:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787364778.313559:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787364778.313604:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787364778.313639:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787364778.313672:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787364778.313720:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787364778.313777:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787364778.315109:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787364778.315178:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787364778.315217:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787364778.315250:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787364778.315300:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787364778.315336:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787364778.315384:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714044032:0@lo:502: 00000100:00100000:2.0:1787364778.315465:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364778.315750:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26000 going to sleep for 11 seconds 00000100:00100000:0.0:1787364778.318781:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714044032 00000100:00100000:0.0:1787364778.319024:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714044032 00000100:00100000:0.0:1787364778.319077:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787364778.319087:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714044032:12345-0@lo:502: 00000100:00100000:0.0:1787364778.319430:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714044032:12345-0@lo:502: Request processed in 344us (3964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.319438:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787364778.323472:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714044032:0@lo:502: 00000040:00080000:3.0:1787364778.327105:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787364778.327128:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787364778.332147:0:6729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787364778.332169:0:6729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b6d04f53370) 00000020:00000080:0.0:1787364778.332191:0:6729:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787364778.332291:0:6729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d055cd000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787364778.332295:0:6729:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d055cd000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787364778.332298:0:6729:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6d055cd000 3 00010000:00080000:0.0:1787364778.332329:0:6729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6c0491f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.102@tcp at head 00010000:00010000:1.0:1787364778.339352:0:6729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787364778.339665:0:6729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787364778.339712:0:6729:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787364778.339726:0:6729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcfc9272e5fc2acdc 00000100:00080000:1.0:1787364778.339737:0:6729:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787364778.339748:0:6729:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b6c0491f800 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:1.0:1787364778.339808:0:6729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d2ffbc700 x1874187714044160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787364778.339837:0:6729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787364778.340716:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714044288:0@lo:400: 00000100:00100000:0.0:1787364778.340806:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364778.340884:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714044288 00000100:00100000:0.0:1787364778.340890:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714044288 00000100:00100000:0.0:1787364778.340951:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787364778.340960:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714044288:12345-0@lo:400: 00000100:00100000:0.0:1787364778.341012:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714044288:12345-0@lo:400: Request processed in 54us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.341020:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787364778.341061:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6d33f03100 x1874187714044288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364778.341074:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714044288:0@lo:400: 00000100:00100000:3.0:1787364778.341236:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874187714044160:0@lo:38: 00000100:00100000:3.0:1787364778.341273:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364778.341666:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714044160 00000100:00100000:0.0:1787364778.341671:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714044160 00000100:00100000:0.0:1787364778.341699:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787364778.341705:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1874187714044160:12345-0@lo:38: 00010000:00080000:0.0:1787364778.341729:0:5857:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1787364778.341758:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcfc9272e5fc2ace3 00000004:00100000:0.0:1787364778.341772:0:5857:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787364778.341819:0:5857:0:(import.c:65:import_set_state_nolock()) ffff9b6c04919800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787364778.341868:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874187714044160:12345-0@lo:38: Request processed in 161us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.341875:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787364778.341907:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6d2ffbc700 x1874187714044160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787364788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364778.341915:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787364778.341930:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787364778.341947:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787364778.341951:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787364778.341954:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6c0491f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787364778.341959:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874187714044160:0@lo:38: 00000040:00080000:0.0:1787364778.352273:0:6729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787364778.354340:0:6705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787364778.354378:0:6705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787364778.354410:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.354422:0:6705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787364778.354493:0:6705:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787364778.354495:0:6705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787364778.354502:0:6705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787364778.354503:0:6705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787364778.354504:0:6705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787364778.354505:0:6705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787364778.354506:0:6705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787364778.354507:0:6705:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787364778.354508:0:6705:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787364778.354510:0:6705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787364778.354511:0:6705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787364778.354515:0:6705:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787364778.354518:0:6705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787364778.354519:0:6705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787364778.354520:0:6705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787364778.354521:0:6705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787364778.354521:0:6705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787364778.354523:0:6705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787364778.354523:0:6705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787364778.354524:0:6705:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787364778.354525:0:6705:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787364778.354526:0:6705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787364778.354527:0:6705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787364778.354556:0:6705:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787364778.354574:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714044416:0@lo:253: 00000100:00100000:3.0:1787364778.354645:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.354685:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c01085780 going to sleep for 11 seconds 00000100:00100000:1.0:1787364778.355036:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714044416 00000100:00100000:1.0:1787364778.355043:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714044416 00000100:00100000:1.0:1787364778.355089:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787364778.355098:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6705:x1874187714044416:12345-0@lo:253: 20000000:01000000:1.0:1787364778.355123:0:5850:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787364778.355137:0:5850:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787364778.402579:0:5850:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787364778.402596:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787364778.402644:0:5872:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787364778.402649:0:5872:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787364778.402671:0:5872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.402689:0:5872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2ac49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.402707:0:5872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.402742:0:5872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2ac49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364778.402755:0:5872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2ac49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 13 pid: 5849 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364778.402769:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874187714044544:0@lo:104: 00000100:00100000:1.0:1787364778.402864:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364778.402925:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787364778.403067:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714044544 00000100:00100000:0.0:1787364778.403075:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714044544 00000100:00100000:0.0:1787364778.403113:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787364778.403121:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5872:x1874187714044544:12345-0@lo:104: 00010000:00010000:0.0:1787364778.403133:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2ac42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364778.403194:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787364778.403200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5872:x1874187714044544:12345-0@lo:104: Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364778.403207:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787364778.403518:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874187714044544:0@lo:104: 00010000:00010000:1.0:1787364778.403537:0:5872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.403650:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787364778.403658:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2ac42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.403666:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1600 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364778.403670:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2ac42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.403678:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2ac42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364778.403697:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2ac42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364778.403715:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364778.403744:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2ac42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.403750:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364778.403772:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2ac42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.403780:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2ac42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac49 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.403809:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364778.403811:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364778.403813:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364778.403820:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787364778.403831:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714044672:0@lo:103: 00000100:00100000:3.0:1787364778.403868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364778.403914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714044672 00000100:00100000:3.0:1787364778.403924:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714044672 00010000:00010000:3.0:1787364778.403951:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2ac49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 14 pid: 5849 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364778.403973:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787364778.403980:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:3313:x1874187714044672:12345-0@lo:103: 00010000:00010000:3.0:1787364778.403990:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364778.403994:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2ac49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 14 pid: 5849 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404009:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2ac49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 14 pid: 5849 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404021:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2ac49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac42 expref: 14 pid: 5849 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404033:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404041:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787364778.404052:0:5842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001404075s 00010000:00010000:3.0:1787364778.404057:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404064:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404071:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404078:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404083:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364778.404087:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404094:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404109:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404117:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364778.404141:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3313:x1874187714044672:12345-0@lo:103: Request processed in 162us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364778.404148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787364778.404189:0:5872:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404196:0:5872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364778.404203:0:5872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2acea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364778.404223:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714044672:0@lo:103: 00000100:00100000:3.0:1787364778.414025:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:6705:x1874187714044416:12345-0@lo:253: Request processed in 58919us (59370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364778.414040:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787364778.414196:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:6705:1874187714044416:0@lo:253: 10000000:01000000:0.0:1787364778.414212:0:6705:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787364778.414215:0:6705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787364778.414217:0:6705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787364778.414218:0:6705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787364778.414219:0:6705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787364778.414221:0:6705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787364778.414222:0:6705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787364778.414223:0:6705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787364778.414224:0:6705:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787364778.414226:0:6705:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787364778.414227:0:6705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787364778.414229:0:6705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787364778.414243:0:6705:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787364778.426632:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787364778.427382:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787364778.427619:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787364778.429149:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787364778.429427:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787364778.431169:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787364778.433663:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787364778.516884:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787364778.776672:0:6705:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787364778.776682:0:6705:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787364778.776717:0:6705:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787364778.777148:0:6705:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787364778.777165:0:6705:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787364778.777190:0:6705:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787364779.535398:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364780.558966:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364781.580446:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364782.602976:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787364783.114948:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787364783.114960:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d20269000 from 21 10000000:01000000:0.0:1787364783.114969:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787364783.115039:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364783.115089:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364783.115103:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364783.115141:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714044800:0@lo:101: 00000100:00100000:0.0:1787364783.115237:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.115302:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d04a6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787364783.115906:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714044800 00000100:00100000:3.0:1787364783.115919:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714044800 00000100:00100000:3.0:1787364783.115994:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787364783.116006:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714044800:12345-0@lo:101: 00010000:00010000:3.0:1787364783.116027:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364783.116047:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2acf1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.116103:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.116296:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.116309:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28335c00, rc 0) 00000100:00100000:3.0:1787364783.116394:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714044800:12345-0@lo:101: Request processed in 390us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364783.116403:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787364783.116571:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714044800:0@lo:101: 00010000:00010000:1.0:1787364783.116592:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.116602:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364783.116682:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714044928:0@lo:501: 00000100:00100000:1.0:1787364783.116718:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.116757:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787364783.116956:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714044928 00000100:00100000:3.0:1787364783.116962:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714044928 00000100:00100000:3.0:1787364783.116998:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787364783.117008:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714044928:12345-0@lo:501: 00000100:00100000:3.0:1787364783.120518:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714044928:12345-0@lo:501: Request processed in 3494us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364783.120539:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787364783.136409:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714044928:0@lo:501: 00000100:00100000:1.0:1787364783.136581:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045056:0@lo:503: 00000100:00100000:1.0:1787364783.136720:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.136813:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787364783.137323:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714045056 00000100:00100000:3.0:1787364783.137333:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714045056 00000100:00100000:3.0:1787364783.137421:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787364783.137433:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714045056:12345-0@lo:503: 00000100:00100000:3.0:1787364783.138003:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714045056:12345-0@lo:503: Request processed in 569us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364783.138015:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787364783.139323:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045056:0@lo:503: 00000100:00100000:2.0:1787364783.143603:0:6922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6922:1874187714045184:0@lo:502: 00000100:00100000:2.0:1787364783.143726:0:6922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364783.144281:0:6922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c01085840 going to sleep for 11 seconds 00000100:00100000:3.0:1787364783.145405:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714045184 00000100:00100000:3.0:1787364783.145422:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714045184 00000100:00100000:3.0:1787364783.145511:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787364783.145543:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6922:x1874187714045184:12345-0@lo:502: 00000100:00100000:3.0:1787364783.150327:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6922:x1874187714045184:12345-0@lo:502: Request processed in 4771us (6585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364783.150347:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787364783.151576:0:6922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6922:1874187714045184:0@lo:502: 00000100:00100000:2.0:1787364783.151687:0:6922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6922:1874187714045312:0@lo:502: 00000100:00100000:2.0:1787364783.151772:0:6922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.152375:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714045312 00000100:00100000:0.0:1787364783.152386:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714045312 00000100:00100000:0.0:1787364783.152454:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787364783.152467:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6922:x1874187714045312:12345-0@lo:502: 00000100:00100000:2.0:1787364783.152977:0:6922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d2968e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787364783.153587:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:6922:x1874187714045312:12345-0@lo:502: Request processed in 1119us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364783.153598:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787364783.156471:0:6922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6922:1874187714045312:0@lo:502: 00000040:00080000:2.0:1787364783.156546:0:6922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787364783.157988:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787364783.158028:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787364783.158044:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.158057:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364783.158069:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787364783.158072:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6d20269000 from 4 10000000:01000000:3.0:1787364783.158075:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787364783.158141:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.158150:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.158162:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364783.158192:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045440:0@lo:101: 00000100:00100000:3.0:1787364783.158279:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364783.158343:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c0dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787364783.158955:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714045440 00000100:00100000:1.0:1787364783.158966:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714045440 00000100:00100000:1.0:1787364783.159026:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787364783.159036:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714045440:12345-0@lo:101: 00010000:00010000:1.0:1787364783.159055:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364783.159075:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2acff expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159131:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159144:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159155:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1600, rc 0) 00000100:00100000:1.0:1787364783.159223:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714045440:12345-0@lo:101: Request processed in 188us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364783.159232:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787364783.159287:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045440:0@lo:101: 00010000:00010000:1.0:1787364783.159307:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159317:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364783.159382:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045568:0@lo:256: 00000100:00100000:1.0:1787364783.159418:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.159439:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364783.159453:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714045568 00000100:00100000:1.0:1787364783.159457:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714045568 00000100:00100000:1.0:1787364783.159480:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787364783.159487:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714045568:12345-0@lo:256: 20000000:01000000:1.0:1787364783.159503:0:5849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787364783.159522:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787364783.159525:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787364783.159606:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714045568:12345-0@lo:256: Request processed in 118us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364783.159614:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787364783.159640:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045568:0@lo:256: 10000000:01000000:1.0:1787364783.159686:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787364783.159693:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159703:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364783.159713:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787364783.159716:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787364783.159719:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787364783.159737:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159746:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159755:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364783.159766:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045696:0@lo:101: 00000100:00100000:1.0:1787364783.159814:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.159842:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364783.159864:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714045696 00000100:00100000:1.0:1787364783.159867:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714045696 00000100:00100000:1.0:1787364783.159885:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787364783.159890:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714045696:12345-0@lo:101: 00010000:00010000:1.0:1787364783.159904:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364783.159915:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ad0d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159932:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159942:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.159949:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0000, rc 0) 00000100:00100000:1.0:1787364783.159976:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714045696:12345-0@lo:101: Request processed in 86us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364783.159983:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787364783.160009:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045696:0@lo:101: 00010000:00010000:1.0:1787364783.160019:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.160027:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364783.160076:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045824:0@lo:501: 00000100:00100000:1.0:1787364783.160100:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.160111:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364783.160121:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714045824 00000100:00100000:1.0:1787364783.160124:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714045824 00000100:00100000:1.0:1787364783.160140:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787364783.160145:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714045824:12345-0@lo:501: 00000100:00100000:1.0:1787364783.160451:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714045824:12345-0@lo:501: Request processed in 304us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364783.160460:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787364783.160485:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045824:0@lo:501: 00000100:00100000:1.0:1787364783.160514:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045952:0@lo:503: 00000100:00100000:1.0:1787364783.160553:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.160566:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364783.160577:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714045952 00000100:00100000:1.0:1787364783.160581:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714045952 00000100:00100000:1.0:1787364783.160597:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787364783.160603:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714045952:12345-0@lo:503: 00000100:00100000:1.0:1787364783.160954:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714045952:12345-0@lo:503: Request processed in 350us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364783.160964:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787364783.161002:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714045952:0@lo:503: 00000100:00100000:1.0:1787364783.161235:0:6923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6923:1874187714046080:0@lo:502: 00000100:00100000:1.0:1787364783.161271:0:6923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.161292:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714046080 00000100:00100000:1.0:1787364783.161296:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714046080 00000100:00100000:1.0:1787364783.161320:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787364783.161326:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:6923:x1874187714046080:12345-0@lo:502: 00000100:00100000:1.0:1787364783.161522:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:6923:x1874187714046080:12345-0@lo:502: Request processed in 195us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364783.161529:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787364783.161557:0:6923:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787364783.161574:0:6923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6923:1874187714046080:0@lo:502: 00000020:01000000:1.0:1787364783.161599:0:6923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787364783.161607:0:6923:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787364783.161616:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364783.161619:0:6923:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787364783.161628:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787364783.161632:0:6923:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.102@tcp to nid 0x20000c0a8cc66 (192.168.204.102@tcp) 00000020:01000000:1.0:1787364783.161660:0:6923:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787364783.161662:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787364783.161682:0:6923:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b6d3ff58000) 00000020:00000080:1.0:1787364783.161704:0:6923:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787364783.161710:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787364783.166229:0:6923:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787364783.166245:0:6923:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787364783.166262:0:6923:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2ad22 00010000:00080000:1.0:1787364783.166312:0:6923:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d202d2800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.102@tcp at head 00010000:00010000:1.0:1787364783.166606:0:6923:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787364783.253658:0:6923:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787364783.253695:0:6923:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787364783.256626:0:6923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787364783.258212:0:6923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787364783.258953:0:6923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787364783.259057:0:6923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787364783.259654:0:6930:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787364783.259660:0:6930:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787364783.260568:0:6923:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787364783.260583:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787364783.260623:0:6923:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787364783.260650:0:6923:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2ad29 00000100:00080000:1.0:1787364783.260664:0:6923:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787364783.260671:0:6923:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6d202d2800 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:1.0:1787364783.260720:0:6923:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d2ffbdf80 x1874187714046208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787364783.260752:0:6923:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787364783.260859:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714046208:0@lo:8: 00000020:01000000:1.0:1787364783.260911:0:6923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787364783.260916:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364783.260919:0:6923:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787364783.260930:0:6923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787364783.260937:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364783.260938:0:6923:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787364783.260942:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787364783.260944:0:6923:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787364783.260977:0:6923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6923:1874187714046336:0@lo:502: 00000100:00100000:0.0:1787364783.260986:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.261049:0:6923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.261078:0:6923:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364783.261085:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714046208 00000100:00100000:0.0:1787364783.261093:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714046208 00000100:00100000:1.0:1787364783.261102:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714046336 00000100:00100000:1.0:1787364783.261107:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714046336 00000100:00100000:1.0:1787364783.261152:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787364783.261163:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:6923:x1874187714046336:12345-0@lo:502: 00000100:00100000:0.0:1787364783.261261:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364783.261269:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874187714046208:12345-0@lo:8: 00010000:00080000:0.0:1787364783.261375:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1787364783.261412:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2ad30 00000100:00100000:1.0:1787364783.261441:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:6923:x1874187714046336:12345-0@lo:502: Request processed in 278us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364783.261450:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00100000:0.0:1787364783.261453:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b6c0491d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787364783.261459:0:6707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787364783.261464:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787364783.261525:0:6923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:6923:1874187714046336:0@lo:502: 00000020:01000000:1.0:1787364783.261563:0:6923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787364783.261568:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364783.261570:0:6923:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787364783.261574:0:6923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00002000:00100000:0.0:1787364783.261614:0:6707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1787364783.261715:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787364783.261740:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787364783.261754:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.261765:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364783.261776:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787364783.261818:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d04f519b8 from 1 10000000:01000000:1.0:1787364783.261822:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787364783.261865:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.261874:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.261884:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364783.261898:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714046464:0@lo:101: 00000100:00100000:1.0:1787364783.261932:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.261962:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787364783.261963:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714046464 00000100:00100000:3.0:1787364783.261969:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714046464 00000100:00100000:3.0:1787364783.262000:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787364783.262015:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714046464:12345-0@lo:101: 00010000:00010000:3.0:1787364783.262026:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364783.262043:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ad37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.262068:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.262079:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364783.262088:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334e00, rc 0) 00000100:00100000:3.0:1787364783.262127:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714046464:12345-0@lo:101: Request processed in 114us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364783.262133:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00002000:00080000:0.0:1787364783.262426:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787364783.262460:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9b6c0491a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787364783.262510:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874187714046208:12345-0@lo:8: Request processed in 1241us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364783.262519:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787364783.262565:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d2ffbdf80 x1874187714046208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787364793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364783.262577:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787364783.262586:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787364783.262595:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787364783.262601:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787364783.262604:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d202d2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787364783.262618:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787364783.262624:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714046208:0@lo:8: 00000100:00100000:1.0:1787364783.267312:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714046464:0@lo:101: 00010000:00010000:1.0:1787364783.267357:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.267374:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364783.267480:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714046848:0@lo:501: 00000100:00100000:1.0:1787364783.267568:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364783.267622:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787364783.267659:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714046848 00000100:00100000:1.0:1787364783.267665:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714046848 00000100:00100000:1.0:1787364783.267717:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787364783.267728:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714046848:12345-0@lo:501: 00000100:00100000:0.0:1787364783.268264:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714046720:0@lo:400: 00000100:00100000:0.0:1787364783.268732:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.268775:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787364783.268808:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714046592:0@lo:400: 00000100:00100000:0.0:1787364783.268830:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.268886:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714046720 00000100:00100000:0.0:1787364783.268972:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714046720 00000100:00100000:0.0:1787364783.269032:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714046592 00000100:00100000:0.0:1787364783.269035:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714046592 00000100:00100000:0.0:1787364783.269053:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787364783.269062:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714046720:12345-0@lo:400: 00000100:00100000:0.0:1787364783.269117:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714046720:12345-0@lo:400: Request processed in 55us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364783.269125:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787364783.269147:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787364783.269153:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714046592:12345-0@lo:400: 00000100:00100000:0.0:1787364783.269181:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714046592:12345-0@lo:400: Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364783.269186:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787364783.269227:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d04fd3800 x1874187714046592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364783.269242:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714046592:0@lo:400: 00000100:00080000:3.0:1787364783.269257:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787364783.269258:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d04fd3480 x1874187714046720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364783.269340:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714046720:0@lo:400: 00000100:00100000:1.0:1787364783.270768:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714046848:12345-0@lo:501: Request processed in 3029us (3188us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787364783.270810:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787364783.270912:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714046848:0@lo:501: 10000000:01000000:1.0:1787364783.270965:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787364783.270978:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364783.270990:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787364783.275455:0:6930:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787364783.275859:0:6930:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 229505072777ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787364783.354810:0:6931:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787364783.354877:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1874187714047104:0@lo:7: 00000100:00100000:0.0:1787364783.354972:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.355156:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d04a6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787364783.355213:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714046976:0@lo:13: 00000100:00100000:0.0:1787364783.355244:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.355300:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714047104 00000100:00100000:0.0:1787364783.355310:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714047104 00000100:00100000:0.0:1787364783.355375:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364783.355385:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6931:x1874187714047104:12345-0@lo:7: 00000100:00100000:0.0:1787364783.361188:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714046976 00000100:00100000:0.0:1787364783.361207:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714046976 00000100:00100000:0.0:1787364783.361281:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364783.361293:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714046976:12345-0@lo:13: 00002000:00000024:0.0:1787364783.361338:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787364783.361461:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714046976:12345-0@lo:13: Request processed in 169us (6215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364783.361470:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787364783.361499:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787364783.361584:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33f03100 x1874187714046976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364783.361609:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714046976:0@lo:13: 00002000:00080000:0.0:1787364783.365426:0:6710:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787364783.365438:0:6710:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787364783.365559:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6931:x1874187714047104:12345-0@lo:7: Request processed in 10168us (10580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364783.365573:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787364783.365644:0:6931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33f02300 x1874187714047104/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787364799 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364783.365664:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1874187714047104:0@lo:7: 00000004:00080000:0.0:1787364783.365685:0:6931:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787364783.365741:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1874187714047232:0@lo:5: 00000100:00100000:0.0:1787364783.365782:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.368741:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d062dcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364783.368781:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714047232 00000100:00100000:0.0:1787364783.369767:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714047232 00000100:00100000:0.0:1787364783.370101:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787364783.370113:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6931:x1874187714047232:12345-0@lo:5: 00002000:00080000:0.0:1787364783.370158:0:6709:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787364783.370163:0:6709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787364783.370621:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6931:x1874187714047232:12345-0@lo:5: Request processed in 510us (4837us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787364783.370631:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787364783.370705:0:6931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33f02300 x1874187714047232/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787364799 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364783.370725:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1874187714047232:0@lo:5: 00000004:00080000:0.0:1787364783.370741:0:6931:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787364783.370966:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f02d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1874187714047360:0@lo:700: 00000100:00100000:0.0:1787364783.371074:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.371119:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d062dcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364783.371144:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714047360 00000100:00100000:0.0:1787364783.371150:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714047360 00000100:00100000:0.0:1787364783.371191:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364783.371200:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6931:x1874187714047360:12345-0@lo:700: 00000100:00100000:1.0:1787364783.371202:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:1.0:1787364783.371211:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:0.0:1787364783.371233:0:6716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f00000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6716:1874187714047488:0@lo:700: 00000100:00100000:0.0:1787364783.371265:0:6716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364783.371283:0:6716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d062dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787364783.371303:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714047488 00000100:00100000:0.0:1787364783.371307:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714047488 00000100:00100000:0.0:1787364783.371333:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364783.371347:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6716:x1874187714047488:12345-0@lo:700: 00000004:00080000:0.0:1787364783.424527:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787364783.497611:0:5863:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787364783.507136:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6716:x1874187714047488:12345-0@lo:700: Request processed in 135773us (135853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364783.507156:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787364783.508318:0:6716:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33f00000 x1874187714047488/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787364799 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364783.508340:0:6716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f00000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6716:1874187714047488:0@lo:700: 40000000:02000000:1.0:1787364783.508361:0:6716:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:2.0:1787364783.630193:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787364783.681359:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787364783.681396:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787364783.681654:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6931:x1874187714047360:12345-0@lo:700: Request processed in 310446us (310571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364783.681682:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787364783.682082:0:6931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33f02d80 x1874187714047360/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787364799 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364783.682099:0:6931:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787364783.682128:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f02d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1874187714047360:0@lo:700: 00000004:02000040:2.0:1787364783.772048:0:6931:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787364783.792429:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1874187714047616:0@lo:5: 00000100:00100000:3.0:1787364783.792539:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364783.792600:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714047616 00000100:00100000:3.0:1787364783.792608:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714047616 00000100:00100000:3.0:1787364783.792679:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787364783.792690:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6931:x1874187714047616:12345-0@lo:5: 00000100:00100000:2.0:1787364783.793626:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c0d300 going to sleep for 11 seconds 00002000:00080000:3.0:1787364783.811353:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787364783.811384:0:6709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787364783.844542:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6931:x1874187714047616:12345-0@lo:5: Request processed in 51835us (51986us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787364783.844582:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787364783.851311:0:6931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d2ffcea00 x1874187714047616/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787364799 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364783.851342:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1874187714047616:0@lo:5: 00000004:00080000:2.0:1787364783.851369:0:6931:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787364784.655112:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364785.681586:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787364786.304818:0:7077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787364786.699199:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364787.731084:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364788.749069:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714047744:0@lo:400: 00000100:00100000:0.0:1787364788.749167:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364788.749229:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714048256:0@lo:13: 00000100:00100000:0.0:1787364788.749260:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364788.749293:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787364788.749301:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714048128:0@lo:400: 00000100:00100000:0.0:1787364788.749322:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364788.749352:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714047872:0@lo:400: 00000100:00100000:0.0:1787364788.749378:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364788.749396:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787364788.749401:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714048000:0@lo:400: 00000100:00100000:0.0:1787364788.749431:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364788.749465:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714048256 00000100:00100000:0.0:1787364788.749472:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714048256 00000100:00100000:0.0:1787364788.749524:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364788.749533:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714048256:12345-0@lo:13: 00002000:00000024:0.0:1787364788.749568:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364788.749609:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714048256:12345-0@lo:13: Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364788.749616:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364788.749639:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714048128 00000100:00100000:0.0:1787364788.749642:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714048128 00000100:00100000:0.0:1787364788.749664:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364788.749670:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714048128:12345-0@lo:400: 00000100:00100000:0.0:1787364788.749721:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714048128:12345-0@lo:400: Request processed in 51us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364788.749728:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787364788.749756:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714047872 00000100:00100000:0.0:1787364788.749760:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714047872 00000100:00100000:0.0:1787364788.749781:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714048000 00000100:00100000:0.0:1787364788.749804:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714048000 00000100:00100000:0.0:1787364788.749823:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787364788.749828:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714047872:12345-0@lo:400: 00000100:00100000:0.0:1787364788.749861:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714047872:12345-0@lo:400: Request processed in 32us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364788.749867:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787364788.749878:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787364788.749884:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714048000:12345-0@lo:400: 00000100:00100000:0.0:1787364788.749910:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714048000:12345-0@lo:400: Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364788.749923:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787364788.749944:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787364788.749948:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787364788.750864:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714047744 00000100:00100000:3.0:1787364788.750873:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714047744 00000100:00100000:3.0:1787364788.750919:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787364788.750929:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3314:x1874187714047744:12345-0@lo:400: 00000100:00100000:3.0:1787364788.750989:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3314:x1874187714047744:12345-0@lo:400: Request processed in 61us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364788.750998:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1787364788.754873:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787364788.755260:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33f00000 x1874187714048000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364788.755279:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714048000:0@lo:400: 00010000:00080000:0.0:1787364788.755296:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33f02300 x1874187714047872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364788.755304:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714047872:0@lo:400: 00010000:00080000:0.0:1787364788.755351:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33dfdc00 x1874187714048128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364788.755363:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714048128:0@lo:400: 00000100:00100000:0.0:1787364788.755375:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714047744:0@lo:400: 00010000:00080000:0.0:1787364788.755384:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33dfe680 x1874187714048256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364788.755400:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714048256:0@lo:13: 00000001:00080000:1.0:1787364788.856808:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787364789.773756:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364790.799890:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364791.826531:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364792.843061:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364793.867573:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714048384:0@lo:400: 00000100:00100000:0.0:1787364793.867671:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364793.867728:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787364793.867735:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714048512:0@lo:400: 00000100:00100000:0.0:1787364793.867760:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364793.867846:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714048640:0@lo:400: 00000100:00100000:0.0:1787364793.867870:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364793.867886:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364793.867890:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714048768:0@lo:400: 00000100:00100000:0.0:1787364793.867921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364793.869085:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714048384 00000100:00100000:1.0:1787364793.869098:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714048384 00000100:00100000:1.0:1787364793.869151:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787364793.869159:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3315:x1874187714048384:12345-0@lo:400: 00000100:00100000:1.0:1787364793.869234:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3315:x1874187714048384:12345-0@lo:400: Request processed in 76us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364793.869241:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787364793.869307:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714048384:0@lo:400: 00000100:00100000:3.0:1787364793.869439:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714048768 00000100:00100000:3.0:1787364793.869444:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714048768 00000100:00100000:3.0:1787364793.869484:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787364793.869492:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714048768:12345-0@lo:400: 00000100:00100000:3.0:1787364793.869533:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714048768:12345-0@lo:400: Request processed in 43us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364793.869540:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787364793.869560:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787364793.869571:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364793.869582:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714048896:0@lo:13: 00000100:00100000:3.0:1787364793.869613:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364793.869659:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714048896 00000100:00100000:3.0:1787364793.869663:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714048896 00000100:00100000:3.0:1787364793.869685:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787364793.869691:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714048896:12345-0@lo:13: 00002000:00000024:3.0:1787364793.869715:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364793.869745:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714048896:12345-0@lo:13: Request processed in 54us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364793.869758:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787364793.870029:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d2ffcc380 x1874187714048896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364793.870039:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787364793.870054:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714048896:0@lo:13: 00010000:00080000:3.0:1787364793.870078:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33dfc380 x1874187714048768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364793.870087:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714048768:0@lo:400: 00010000:00010000:2.0:1787364793.875601:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364793.875798:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714048512 00000100:00100000:1.0:1787364793.875810:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714048512 00000100:00100000:0.0:1787364793.875985:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714048640 00000100:00100000:0.0:1787364793.875990:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714048640 00000100:00100000:0.0:1787364793.876109:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787364793.876121:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714048640:12345-0@lo:400: 00000100:00100000:0.0:1787364793.876215:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714048640:12345-0@lo:400: Request processed in 97us (8343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364793.876223:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787364793.876285:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33dfce00 x1874187714048640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364793.876303:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714048640:0@lo:400: 00000100:00100000:1.0:1787364793.877097:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787364793.877111:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714048512:12345-0@lo:400: 00000100:00100000:1.0:1787364793.877173:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714048512:12345-0@lo:400: Request processed in 68us (9412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364793.877180:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787364793.877222:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33dfdc00 x1874187714048512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364793.877235:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714048512:0@lo:400: 00000100:00080000:3.0:1787364793.883119:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787364794.890957:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364795.915331:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364796.946253:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364797.965838:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364798.987231:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714049280:0@lo:400: 00000100:00100000:2.0:1787364798.987338:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364798.987420:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787364798.987426:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714049152:0@lo:400: 00000100:00100000:2.0:1787364798.987463:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364798.987600:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714049024:0@lo:13: 00000100:00100000:3.0:1787364798.987640:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364798.987671:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714049536:0@lo:400: 00000100:00100000:3.0:1787364798.987695:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364798.987718:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364798.987724:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714049408:0@lo:400: 00000100:00100000:3.0:1787364798.987745:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364798.987778:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714049536 00000100:00100000:3.0:1787364798.987823:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714049536 00000100:00100000:3.0:1787364798.987893:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787364798.987903:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714049536:12345-0@lo:400: 00000100:00100000:3.0:1787364798.987964:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714049536:12345-0@lo:400: Request processed in 62us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364798.987972:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787364798.988006:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714049280 00000100:00100000:3.0:1787364798.988026:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714049280 00000100:00100000:3.0:1787364798.988053:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714049408 00000100:00100000:3.0:1787364798.988056:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714049408 00000100:00100000:3.0:1787364798.988074:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787364798.988080:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714049280:12345-0@lo:400: 00000100:00100000:3.0:1787364798.988116:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714049280:12345-0@lo:400: Request processed in 36us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364798.988123:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787364798.988134:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787364798.988140:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714049408:12345-0@lo:400: 00000100:00100000:3.0:1787364798.988164:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714049408:12345-0@lo:400: Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364798.988170:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787364798.988186:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787364798.988191:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787364798.988229:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d04fd2680 x1874187714049408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364798.988245:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714049408:0@lo:400: 00010000:00080000:3.0:1787364798.988257:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d04fd2d80 x1874187714049536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364798.988265:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714049536:0@lo:400: 00010000:00080000:3.0:1787364798.988299:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d04fd1c00 x1874187714049280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364798.988309:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714049280:0@lo:400: 00000100:00100000:1.0:1787364798.988549:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714049152 00000100:00100000:1.0:1787364798.988555:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714049152 00000100:00100000:1.0:1787364798.988596:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787364798.988604:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3314:x1874187714049152:12345-0@lo:400: 00000100:00100000:1.0:1787364798.988659:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3314:x1874187714049152:12345-0@lo:400: Request processed in 56us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364798.988666:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1787364798.988733:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364798.988910:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714049024 00000100:00100000:2.0:1787364798.988915:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714049024 00000100:00100000:2.0:1787364798.988956:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787364798.988963:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714049024:12345-0@lo:13: 00002000:00000024:2.0:1787364798.989001:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364798.989055:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714049024:12345-0@lo:13: Request processed in 92us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364798.989062:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787364798.989195:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d33dfce00 x1874187714049024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364798.989215:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714049024:0@lo:13: 00000100:00100000:3.0:1787364798.989677:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714049152:0@lo:400: 00000020:01000004:2.0:1787364799.815020:0:7645:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787364799.815027:0:7645:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787364799.815194:0:7645:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b6c06f84800 00000020:01000004:2.0:1787364799.815596:0:7645:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787364799.815616:0:7645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787364799.815637:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b6d04fd99b8) 00000020:00000080:2.0:1787364799.815658:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787364799.839292:0:7645:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787364799.839757:0:7645:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787364799.862617:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787364799.867601:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787364799.867646:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787364799.867708:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787364799.867736:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787364799.868290:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787364799.868311:0:7645:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787364799.868324:0:7645:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcfc9272e5fc2ad4c 00000020:01000004:2.0:1787364799.868335:0:7645:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787364799.868365:0:7645:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.102@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787364799.868369:0:7645:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787364799.868376:0:7645:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787364799.868406:0:7645:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787364799.868411:0:7645:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787364799.887183:0:7645:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787364799.887418:0:7645:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.102@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787364799.887423:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787364799.887425:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787364799.887426:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787364799.887428:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787364799.887429:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787364799.887430:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787364799.887432:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787364799.887434:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787364799.887435:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787364799.887438:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787364799.887440:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787364799.887445:0:7645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787364799.887447:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787364799.887449:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787364799.887450:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787364799.887451:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787364799.887452:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787364799.887453:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787364799.887454:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787364799.887455:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787364799.887456:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787364799.887457:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787364799.887458:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787364799.887707:0:7645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787364799.887735:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714049664:0@lo:253: 00000100:00100000:2.0:1787364799.887959:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364799.888152:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714049664 00000100:00100000:3.0:1787364799.888163:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714049664 00000100:00100000:2.0:1787364799.888225:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063f90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364799.888367:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787364799.888380:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:7645:x1874187714049664:12345-0@lo:253: 20000000:01000000:3.0:1787364799.888424:0:5851:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787364799.888429:0:5851:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787364799.888436:0:5851:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787364799.888440:0:5851:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787364799.889835:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787364799.890103:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787364799.890120:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787364799.890163:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787364799.890171:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787364799.890203:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787364799.890256:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787364799.890726:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787364799.890754:0:5851:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.102@tcp 20000000:01000000:3.0:1787364799.890757:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.102@tcp (null) (null) (null) 00000040:00080000:3.0:1787364799.890854:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787364799.890863:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787364799.890915:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787364799.890924:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.102@tcp (null) (null) 00000040:00080000:3.0:1787364799.890957:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787364799.890967:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787364799.891000:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787364799.891050:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787364799.892989:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787364799.893099:0:5851:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.102@tcp 20000000:01000000:3.0:1787364799.893112:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.102@tcp (null) (null) (null) 00000040:00080000:3.0:1787364799.893154:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787364799.893163:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787364799.893191:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787364799.893197:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.102@tcp (null) (null) 00000040:00080000:3.0:1787364799.893299:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787364799.893310:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787364799.893357:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787364799.893392:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787364799.893410:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787364799.893414:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787364799.893422:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787364799.893424:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787364799.893426:0:5851:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787364799.893442:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787364799.893445:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787364799.893670:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787364799.893673:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787364799.894873:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787364799.894994:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787364799.895330:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787364799.896037:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787364799.896089:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787364799.896166:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787364799.896184:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787364799.896187:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787364799.897115:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787364799.897195:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787364799.897253:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787364799.897617:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787364799.897663:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787364799.897701:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787364799.897714:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787364799.897717:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787364799.898323:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787364799.898591:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787364799.898634:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787364799.898709:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787364799.898722:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787364799.898724:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787364799.901413:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787364799.901546:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787364799.901607:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787364799.902175:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787364799.902222:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787364799.902295:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1787364799.902316:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787364799.902342:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902367:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902376:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902384:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902391:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902398:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902407:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902460:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902479:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 16 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.902497:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714049792:0@lo:104: 00000100:00100000:3.0:1787364799.902630:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787364799.902748:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902758:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 16 pid: 5849 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.902768:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714049920:0@lo:104: 00010000:00010000:3.0:1787364799.902830:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902838:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 16 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.902847:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714050048:0@lo:104: 00010000:00010000:3.0:1787364799.902875:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902883:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 16 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.902891:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffce680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714050176:0@lo:104: 00010000:00010000:3.0:1787364799.902916:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.902925:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 16 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.902933:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714050304:0@lo:104: 00000100:00100000:3.0:1787364799.902965:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c55e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364799.903480:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787364799.903506:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.903583:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.903640:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364799.903661:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714049792 00000100:00100000:1.0:1787364799.903671:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714049792 00000100:00100000:1.0:1787364799.903725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714049920 00000100:00100000:1.0:1787364799.903728:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714049920 00000100:00100000:1.0:1787364799.903740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714050048 00000100:00100000:1.0:1787364799.903743:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714050048 00000100:00100000:1.0:1787364799.903758:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787364799.903769:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d12011050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:5851:x1874187714049792:12345-0@lo:104: 00010000:00010000:1.0:1787364799.903817:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.903910:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787364799.903917:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d12011050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:5851:x1874187714049792:12345-0@lo:104: Request processed in 151us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364799.903926:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787364799.903990:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787364799.903998:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:5851:x1874187714049920:12345-0@lo:104: 00010000:00010000:1.0:1787364799.904007:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904048:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787364799.904053:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:5851:x1874187714049920:12345-0@lo:104: Request processed in 57us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364799.904060:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787364799.904071:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787364799.904077:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5851:x1874187714050048:12345-0@lo:104: 00010000:00010000:1.0:1787364799.904095:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904121:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787364799.904126:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5851:x1874187714050048:12345-0@lo:104: Request processed in 49us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364799.904132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787364799.904153:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787364799.904161:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904169:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1800 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787364799.904174:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904185:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787364799.904193:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364799.904200:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787364799.904238:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904245:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787364799.904270:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904279:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1800/0xcfc9272e5fc2ad37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad3e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904322:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787364799.904326:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904332:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0c00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787364799.904336:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904342:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787364799.904349:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364799.904354:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787364799.904368:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904374:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787364799.904379:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904386:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904396:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787364799.904399:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904415:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030200 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787364799.904418:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904425:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787364799.904432:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364799.904437:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787364799.904453:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904460:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787364799.904478:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904485:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d00030200/0xcfc9272e5fc2acf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acf8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904496:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364799.904498:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364799.904500:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364799.904542:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714050432:0@lo:103: 00000100:00100000:1.0:1787364799.904585:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364799.904632:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364799.904639:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714050560:0@lo:103: 00000100:00100000:1.0:1787364799.904674:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364799.904708:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714050688:0@lo:103: 00000100:00100000:1.0:1787364799.904734:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364799.904782:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714050432 00000100:00100000:1.0:1787364799.904831:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714050432 00010000:00010000:1.0:1787364799.904859:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 17 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364799.904879:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714050560 00000100:00100000:1.0:1787364799.904882:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714050560 00010000:00010000:1.0:1787364799.904894:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 18 pid: 5849 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364799.904904:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714050688 00000100:00100000:1.0:1787364799.904907:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714050688 00010000:00010000:1.0:1787364799.904917:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 19 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364799.904930:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787364799.904936:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714050432:12345-0@lo:103: 00010000:00010000:1.0:1787364799.904950:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364799.904956:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 19 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904968:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 19 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.904991:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364799.905024:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714050432:12345-0@lo:103: Request processed in 88us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364799.905041:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787364799.905056:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787364799.905062:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:3313:x1874187714050560:12345-0@lo:103: 00010000:00010000:1.0:1787364799.905071:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364799.905076:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 18 pid: 5849 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.905085:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 18 pid: 5849 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.905096:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364799.905120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:3313:x1874187714050560:12345-0@lo:103: Request processed in 58us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364799.905126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787364799.905138:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787364799.905144:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:3315:x1874187714050688:12345-0@lo:103: 00010000:00010000:1.0:1787364799.905152:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364799.905156:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 17 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.905164:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 17 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.905174:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364799.905197:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:3315:x1874187714050688:12345-0@lo:103: Request processed in 54us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364799.905203:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787364799.905247:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714050688:0@lo:103: 00000100:00100000:1.0:1787364799.905297:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714050560:0@lo:103: 00000100:00100000:1.0:1787364799.905305:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714050432:0@lo:103: 00010000:00010000:0.0:1787364799.905550:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364799.905669:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2ad3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad37 expref: 16 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.905687:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714049792:0@lo:104: 00010000:00010000:3.0:1787364799.905700:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0000/0xcfc9272e5fc2ad14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad0d expref: 15 pid: 5849 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.905708:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714049920:0@lo:104: 00010000:00010000:3.0:1787364799.905719:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2acf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2acf1 expref: 14 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.905730:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714050048:0@lo:104: 00000100:00100000:2.0:1787364799.905971:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364799.906130:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714050176 00000100:00100000:0.0:1787364799.906137:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714050176 00000100:00100000:0.0:1787364799.906170:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714050304 00000100:00100000:0.0:1787364799.906172:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714050304 00000100:00100000:0.0:1787364799.906183:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787364799.906191:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:5851:x1874187714050176:12345-0@lo:104: 00010000:00010000:0.0:1787364799.906205:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906279:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787364799.906285:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:5851:x1874187714050176:12345-0@lo:104: Request processed in 95us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364799.906303:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787364799.906321:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787364799.906328:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5851:x1874187714050304:12345-0@lo:104: 00010000:00010000:0.0:1787364799.906336:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906373:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787364799.906378:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5851:x1874187714050304:12345-0@lo:104: Request processed in 52us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364799.906385:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787364799.906399:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787364799.906405:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906412:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1400 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364799.906417:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906426:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364799.906434:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364799.906440:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787364799.906476:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906483:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364799.906506:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906514:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2acc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906542:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364799.906545:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906552:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364799.906554:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906561:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364799.906568:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364799.906574:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787364799.906587:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906593:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364799.906604:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906611:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2ac9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2aca4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.906626:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364799.906635:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364799.906637:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364799.906698:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffce680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714050176:0@lo:104: 00000100:00100000:3.0:1787364799.906708:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5851:1874187714050304:0@lo:104: 00010000:00010000:3.0:1787364799.906741:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364799.906851:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714050816:0@lo:103: 00000100:00100000:1.0:1787364799.906900:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364799.906956:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787364799.906964:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714050944:0@lo:103: 00000100:00100000:1.0:1787364799.906990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787364799.907026:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364799.907161:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714050816 00000100:00100000:3.0:1787364799.907167:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714050816 00010000:00010000:3.0:1787364799.907191:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 14 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.907226:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714050944 00000100:00100000:3.0:1787364799.907229:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714050944 00010000:00010000:3.0:1787364799.907241:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 15 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364799.907255:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787364799.907270:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:3316:x1874187714050816:12345-0@lo:103: 00010000:00010000:3.0:1787364799.907283:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364799.907289:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 15 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907300:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 15 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907315:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2acce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2acc7 expref: 15 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907328:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364799.907362:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:3316:x1874187714050816:12345-0@lo:103: Request processed in 92us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364799.907369:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787364799.907384:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787364799.907391:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3314:x1874187714050944:12345-0@lo:103: 00010000:00010000:3.0:1787364799.907398:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364799.907402:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 13 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907411:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 13 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907422:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2aca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac9d expref: 13 pid: 5851 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907434:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907452:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907468:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907476:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907484:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907491:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907497:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364799.907501:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907510:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907540:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907551:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364799.907578:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:3314:x1874187714050944:12345-0@lo:103: Request processed in 188us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364799.907585:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787364799.907604:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907618:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.907625:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad53 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787364799.907645:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787364799.907762:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714050944:0@lo:103: 00000100:00100000:1.0:1787364799.907824:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714050816:0@lo:103: 00000100:00100000:0.0:1787364799.957609:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:7645:x1874187714049664:12345-0@lo:253: Request processed in 69214us (69633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364799.957630:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787364799.957913:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714049664:0@lo:253: 10000000:01000000:1.0:1787364799.957934:0:7645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787364799.957938:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787364799.957940:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787364799.957941:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787364799.957943:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787364799.957945:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787364799.957946:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787364799.957948:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787364799.957950:0:7645:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787364799.957952:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787364799.957954:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787364799.957982:0:7645:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6c06f84800 from lustre-OST0001 10000000:01000000:1.0:1787364799.958015:0:7645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787364799.958019:0:7645:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787364799.958030:0:7645:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6d04f519b8 local copy 10000000:01000000:1.0:1787364799.958035:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787364799.958086:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.958117:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364799.958129:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364799.958153:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051072:0@lo:101: 00000100:00100000:1.0:1787364799.958202:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364799.958244:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364799.958323:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714051072 00000100:00100000:0.0:1787364799.958330:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714051072 00000100:00100000:0.0:1787364799.958387:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787364799.958398:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+11:7645:x1874187714051072:12345-0@lo:101: 00010000:00010000:0.0:1787364799.958414:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364799.958432:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ad61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ad5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.958461:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ad61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad5a expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.958474:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ad61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad5a expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.958485:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030200, rc 0) 00000100:00100000:0.0:1787364799.958679:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051072:12345-0@lo:101: Request processed in 283us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364799.958687:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787364799.958967:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051072:0@lo:101: 00010000:00010000:2.0:1787364799.958982:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.958993:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364799.959131:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051200:0@lo:501: 00000100:00100000:2.0:1787364799.959184:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.959258:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3c6f9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787364799.959299:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714051200 00000100:00100000:0.0:1787364799.959304:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714051200 00000100:00100000:0.0:1787364799.959369:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787364799.959378:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051200:12345-0@lo:501: 00000100:00100000:0.0:1787364799.959715:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051200:12345-0@lo:501: Request processed in 336us (529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787364799.959732:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787364799.959830:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051200:0@lo:501: 10000000:01000000:2.0:1787364799.959846:0:7645:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787364799.959872:0:7645:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787364799.959878:0:7645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.959889:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.959897:0:7645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.959923:0:7645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787364799.959954:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6c06f84800 10000000:01000000:2.0:1787364799.959960:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787364799.959965:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787364799.959968:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787364799.959973:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787364799.959976:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787364799.960000:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.960008:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.960016:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364799.960031:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051328:0@lo:101: 00000100:00100000:2.0:1787364799.960060:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787364799.960104:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787364799.960113:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.960121:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0c00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364799.960126:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.960135:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364799.960142:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364799.960149:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364799.960173:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.960180:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364799.960201:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.960208:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2ad5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfc9272e5fc2ad61 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.960231:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364799.960233:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364799.960235:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364799.960491:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3c6f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787364799.960617:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714051328 00000100:00100000:1.0:1787364799.960624:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714051328 00000100:00100000:3.0:1787364799.960673:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787364799.960684:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051328:12345-0@lo:101: 00010000:00010000:3.0:1787364799.960696:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364799.960713:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ad68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.960740:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.960752:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364799.960763:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334600, rc 0) 00000100:00100000:3.0:1787364799.960909:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714051328:12345-0@lo:101: Request processed in 227us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364799.960916:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787364799.960993:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051328:0@lo:101: 00010000:00010000:2.0:1787364799.961008:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.961017:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364799.961118:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051584:0@lo:501: 00000100:00100000:2.0:1787364799.961161:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.961188:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3c6f9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787364799.961246:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714051584 00000100:00100000:3.0:1787364799.961250:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714051584 00000100:00100000:3.0:1787364799.961270:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787364799.961276:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714051584:12345-0@lo:501: 00000100:00100000:3.0:1787364799.961590:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714051584:12345-0@lo:501: Request processed in 313us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364799.961598:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787364799.961722:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051584:0@lo:501: 00000100:00100000:2.0:1787364799.961751:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051712:0@lo:503: 00000100:00100000:2.0:1787364799.961935:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.961985:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3c6f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364799.962059:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714051456:0@lo:103: 00000100:00100000:0.0:1787364799.962095:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.962176:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714051456 00000100:00100000:2.0:1787364799.962181:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714051456 00000100:00100000:2.0:1787364799.962226:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787364799.962235:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3314:x1874187714051456:12345-0@lo:103: 00010000:00010000:2.0:1787364799.962248:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364799.962271:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ad61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad5a expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.962287:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364799.962315:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:3314:x1874187714051456:12345-0@lo:103: Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364799.962322:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364799.962384:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714051456:0@lo:103: 00000100:00100000:1.0:1787364799.962454:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714051712 00000100:00100000:1.0:1787364799.962459:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714051712 00000100:00100000:1.0:1787364799.962478:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787364799.962485:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051712:12345-0@lo:503: 00000100:00100000:1.0:1787364799.962729:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051712:12345-0@lo:503: Request processed in 242us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364799.962736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787364799.963181:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051712:0@lo:503: 00000040:00080000:2.0:1787364799.963562:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787364799.963664:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051840:0@lo:502: 00000100:00100000:2.0:1787364799.963727:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.963774:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3c6f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364799.963935:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714051840 00000100:00100000:0.0:1787364799.963941:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714051840 00000100:00100000:0.0:1787364799.963986:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787364799.963995:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051840:12345-0@lo:502: 00000100:00100000:0.0:1787364799.964197:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051840:12345-0@lo:502: Request processed in 203us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364799.964205:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787364799.964432:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051840:0@lo:502: 00000040:00080000:2.0:1787364799.964775:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787364799.965003:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787364799.965055:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787364799.965106:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787364799.965145:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787364799.965177:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787364799.965223:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051968:0@lo:502: 00000100:00100000:2.0:1787364799.965299:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.965337:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3c6f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364799.965425:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714051968 00000100:00100000:0.0:1787364799.965432:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714051968 00000100:00100000:0.0:1787364799.965478:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787364799.965487:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051968:12345-0@lo:502: 00000100:00100000:0.0:1787364799.965724:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714051968:12345-0@lo:502: Request processed in 237us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364799.965733:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787364799.965918:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714051968:0@lo:502: 00000040:00080000:1.0:1787364799.966042:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787364799.966055:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787364799.966727:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787364799.966739:0:7652:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787364799.966747:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364799.966751:0:7652:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787364799.966756:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787364799.966777:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b6d3ff5b370) 00000020:00000080:1.0:1787364799.966912:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787364799.966931:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787364799.967082:0:7652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6c06f84800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787364799.967092:0:7652:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787364799.967104:0:7652:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcfc9272e5fc2ad7d 00010000:00010000:2.0:1787364799.973918:0:7652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787364799.974406:0:7652:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787364799.977535:0:7652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787364799.978002:0:7652:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787364799.984047:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787364799.987063:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787364799.989013:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787364799.989034:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787364799.989043:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364799.989046:0:7652:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787364799.989051:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787364799.989056:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364799.989057:0:7652:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787364799.989060:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787364799.989062:0:7652:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787364799.989310:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787364799.989315:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364799.989317:0:7652:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787364799.989322:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787364799.989761:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787364799.990093:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787364799.990155:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.990171:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364799.990180:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6c06f84800 from 1 10000000:01000000:2.0:1787364799.990184:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787364799.990238:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.990247:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.990261:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364799.990304:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052096:0@lo:101: 00000100:00100000:2.0:1787364799.990426:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.990488:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3c6f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364799.990700:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714052096 00000100:00100000:0.0:1787364799.990710:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714052096 00000100:00100000:0.0:1787364799.990775:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787364799.990818:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:7645:x1874187714052096:12345-0@lo:101: 00010000:00010000:0.0:1787364799.990837:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364799.990853:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ad84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.990884:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.990895:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364799.990905:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031c00, rc 0) 00000100:00100000:0.0:1787364799.990953:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052096:12345-0@lo:101: Request processed in 139us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364799.990961:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787364799.991120:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052096:0@lo:101: 00010000:00010000:2.0:1787364799.991139:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364799.991149:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364799.991291:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052224:0@lo:501: 00000100:00100000:2.0:1787364799.991376:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364799.991409:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3c6f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364799.991428:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714052224 00000100:00100000:2.0:1787364799.991432:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714052224 00000100:00100000:2.0:1787364799.991459:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787364799.991467:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052224:12345-0@lo:501: 00000100:00100000:2.0:1787364799.992100:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052224:12345-0@lo:501: Request processed in 630us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364799.992109:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787364799.992179:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052224:0@lo:501: 00000100:00100000:0.0:1787364799.992221:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052352:0@lo:503: 00000100:00100000:0.0:1787364799.992270:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364799.992386:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364799.992424:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714052352 00000100:00100000:2.0:1787364799.992429:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714052352 00000100:00100000:2.0:1787364799.992494:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787364799.992511:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052352:12345-0@lo:503: 00000100:00100000:2.0:1787364799.992951:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052352:12345-0@lo:503: Request processed in 439us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364799.992967:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787364799.993063:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052352:0@lo:503: 00000040:00080000:1.0:1787364799.993481:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787364799.993615:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052480:0@lo:502: 00000100:00100000:1.0:1787364799.993668:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364799.999426:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06347b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364799.999668:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714052480 00000100:00100000:0.0:1787364799.999680:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714052480 00000100:00100000:0.0:1787364799.999745:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787364799.999767:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052480:12345-0@lo:502: 00000100:00100000:0.0:1787364800.002418:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052480:12345-0@lo:502: Request processed in 2639us (8735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364800.002436:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787364800.002820:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052480:0@lo:502: 00000040:00080000:1.0:1787364800.003178:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787364800.003249:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787364800.003299:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052608:0@lo:502: 00000100:00100000:1.0:1787364800.003369:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364800.003418:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787364800.005637:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714052608 00000100:00100000:2.0:1787364800.005655:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714052608 00000100:00100000:2.0:1787364800.005735:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787364800.005748:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052608:12345-0@lo:502: 00000100:00100000:2.0:1787364800.006138:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052608:12345-0@lo:502: Request processed in 392us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364800.006147:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787364800.006441:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052608:0@lo:502: 00000040:00080000:1.0:1787364800.006781:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787364800.006838:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787364800.011771:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787364800.011899:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787364800.011902:0:7656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787364800.011911:0:7656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6c06f84800 00000020:00000080:2.0:1787364800.011914:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787364800.011940:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787364800.011944:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787364800.011945:0:7656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787364800.011949:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00010000:00010000:2.0:1787364800.012299:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787364800.013984:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787364800.014038:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787364800.014117:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364800.014135:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364800.016002:0:7645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787364800.016014:0:7645:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6c06f84800 10000000:01000000:0.0:1787364800.016019:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6c06f84800 10000000:01000000:0.0:1787364800.016025:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787364800.016035:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6c06f84800 from 1 10000000:01000000:0.0:1787364800.016039:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787364800.016102:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364800.016117:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364800.016131:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364800.016170:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052736:0@lo:101: 00000100:00100000:0.0:1787364800.016275:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364800.016405:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49240 going to sleep for 11 seconds 00000100:00100000:3.0:1787364800.018108:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714052736 00000100:00100000:3.0:1787364800.018140:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714052736 00000100:00100000:3.0:1787364800.019703:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787364800.019730:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714052736:12345-0@lo:101: 00010000:00010000:3.0:1787364800.019758:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364800.019802:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ad92 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364800.019846:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364800.019861:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364800.019872:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28335c00, rc 0) 00000100:00100000:3.0:1787364800.019993:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714052736:12345-0@lo:101: Request processed in 275us (3717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364800.020001:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787364800.020688:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052736:0@lo:101: 00010000:00010000:0.0:1787364800.020715:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364800.020727:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364800.020922:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052864:0@lo:501: 00000100:00100000:0.0:1787364800.020984:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364800.023199:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49240 going to sleep for 11 seconds 00000100:00100000:2.0:1787364800.023355:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714052864 00000100:00100000:2.0:1787364800.023368:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714052864 00000100:00100000:2.0:1787364800.023431:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787364800.023443:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714052864:12345-0@lo:501: 00000100:00100000:2.0:1787364800.023998:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714052864:12345-0@lo:501: Request processed in 555us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364800.024007:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787364800.024232:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052864:0@lo:501: 00000100:00100000:0.0:1787364800.024317:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052992:0@lo:503: 00000100:00100000:0.0:1787364800.024384:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364800.024425:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49240 going to sleep for 11 seconds 00000100:00100000:2.0:1787364800.024817:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714052992 00000100:00100000:2.0:1787364800.024824:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714052992 00000100:00100000:2.0:1787364800.024865:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787364800.024873:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714052992:12345-0@lo:503: 00000100:00100000:2.0:1787364800.025092:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714052992:12345-0@lo:503: Request processed in 219us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364800.025100:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787364800.025204:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714052992:0@lo:503: 00000040:00080000:0.0:1787364800.026689:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787364800.026819:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714053120:0@lo:502: 00000100:00100000:0.0:1787364800.026916:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364800.026955:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49240 going to sleep for 11 seconds 00000100:00100000:2.0:1787364800.027139:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714053120 00000100:00100000:2.0:1787364800.027148:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714053120 00000100:00100000:2.0:1787364800.027195:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787364800.027205:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714053120:12345-0@lo:502: 00000100:00100000:2.0:1787364800.027577:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714053120:12345-0@lo:502: Request processed in 372us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364800.027586:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787364800.028025:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714053120:0@lo:502: 00000040:00080000:0.0:1787364800.028387:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787364800.028450:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787364800.028489:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787364800.028980:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787364800.029026:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787364800.029079:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787364800.029130:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787364800.029164:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787364800.029215:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787364800.029251:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787364800.029286:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787364800.029608:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787364800.029642:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787364800.029671:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787364800.029712:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787364800.029768:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787364800.030005:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787364800.030059:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787364800.030096:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787364800.030128:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787364800.030173:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787364800.030211:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787364800.030247:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787364800.030296:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787364800.030403:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787364800.030439:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787364800.030598:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787364800.030639:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787364800.030678:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787364800.030750:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787364800.030967:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787364800.031007:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787364800.031039:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787364800.031088:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787364800.031123:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787364800.031169:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787364800.031204:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787364800.031274:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714053248:0@lo:502: 00000100:00100000:0.0:1787364800.031477:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364800.031664:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49240 going to sleep for 11 seconds 00000100:00100000:2.0:1787364800.031744:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714053248 00000100:00100000:2.0:1787364800.031755:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714053248 00000100:00100000:2.0:1787364800.032042:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787364800.032056:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714053248:12345-0@lo:502: 00000100:00100000:2.0:1787364800.032409:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714053248:12345-0@lo:502: Request processed in 354us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364800.032418:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787364800.032662:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714053248:0@lo:502: 00000040:00080000:0.0:1787364800.032829:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787364800.032846:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787364800.033319:0:7657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787364800.033340:0:7657:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b6d04f54d28) 00000020:00000080:0.0:1787364800.033368:0:7657:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787364800.033475:0:7657:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6c06f84800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787364800.033481:0:7657:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6c06f84800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787364800.033484:0:7657:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6c06f84800 3 00010000:00080000:0.0:1787364800.033539:0:7657:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d06348800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.102@tcp at head 00010000:00010000:0.0:1787364800.036876:0:7657:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787364800.037129:0:7657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787364800.037187:0:7657:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787364800.037205:0:7657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcfc9272e5fc2ada7 00000100:00080000:0.0:1787364800.037221:0:7657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787364800.037229:0:7657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b6d06348800 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:0.0:1787364800.037279:0:7657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d33dff800 x1874187714053376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787364800.038626:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874187714053376:0@lo:38: 00000100:00100000:0.0:1787364800.038752:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787364800.038969:0:7657:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787364800.041062:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714053504:0@lo:400: 00000100:00100000:1.0:1787364800.041181:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787364800.044625:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1787364800.044712:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787364800.044742:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787364800.044770:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364800.044847:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787364800.044910:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787364800.044912:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787364800.044914:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787364800.044915:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787364800.044917:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787364800.044918:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787364800.044920:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787364800.044921:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787364800.044923:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787364800.044925:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787364800.044926:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787364800.044932:0:7645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787364800.044934:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787364800.044935:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787364800.044936:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787364800.044937:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787364800.044938:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787364800.044939:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787364800.044941:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787364800.044942:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787364800.044943:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787364800.044943:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787364800.044944:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787364800.044980:0:7645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787364800.045006:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714053888:0@lo:253: 00000100:00100000:0.0:1787364800.045108:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364800.045159:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49300 going to sleep for 11 seconds 00000100:00080000:3.0:1787364800.047809:0:7658:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9b6d2ffce680 x1874187714054016/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364800.047828:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c55300 going to sleep for 0 seconds 00000100:00100000:1.0:1787364800.049768:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714053632:0@lo:400: 00000100:00100000:1.0:1787364800.049874:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364800.051236:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714053376 00000100:00100000:2.0:1787364800.051253:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714053376 00000100:00100000:3.0:1787364800.053874:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714053504 00000100:00100000:3.0:1787364800.053895:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714053504 00000100:00100000:3.0:1787364800.053981:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787364800.053993:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714053504:12345-0@lo:400: 00000100:00100000:3.0:1787364800.054122:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714053504:12345-0@lo:400: Request processed in 130us (12941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364800.054130:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787364800.054149:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787364800.054154:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874187714053376:12345-0@lo:38: 00010000:00080000:3.0:1787364800.054198:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1787364800.054242:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcfc9272e5fc2adae 00000004:00100000:3.0:1787364800.054263:0:5856:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787364800.054309:0:5856:0:(import.c:65:import_set_state_nolock()) ffff9b6d202d4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787364800.054368:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874187714053376:12345-0@lo:38: Request processed in 212us (15618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364800.054375:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787364800.055122:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dff800 x1874187714053376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787364810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364800.055138:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787364800.055148:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787364800.055171:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787364800.055178:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787364800.055181:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d06348800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787364800.055191:0:3312:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a28ec8f9): req@ffff9b6d2ffce680 x1874187714054016/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364800.055214:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874187714053376:0@lo:38: 00000100:00100000:3.0:1787364800.055800:0:7658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364800.055840:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c55300 going to sleep for 11 seconds 00000100:00100000:2.0:1787364800.055905:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714054016 00000100:00100000:2.0:1787364800.055913:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714054016 00000100:00100000:1.0:1787364800.055962:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714053760:0@lo:400: 00000100:00100000:2.0:1787364800.055964:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787364800.055973:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1874187714054016:12345-0@lo:901: 00000100:00100000:1.0:1787364800.055999:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364800.056041:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714053632 00000100:00100000:1.0:1787364800.056046:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714053632 00000100:00100000:1.0:1787364800.056079:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787364800.056098:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714053632:12345-0@lo:400: 00000100:00100000:1.0:1787364800.056146:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714053632:12345-0@lo:400: Request processed in 50us (6273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364800.056154:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787364800.056185:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714053760 00000100:00100000:1.0:1787364800.056189:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714053760 00000100:00100000:1.0:1787364800.056220:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787364800.056227:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714053760:12345-0@lo:400: 00000100:00100000:1.0:1787364800.056263:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714053760:12345-0@lo:400: Request processed in 36us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364800.056271:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787364800.056311:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbf800 x1874187714053760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364800.056325:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714053760:0@lo:400: 00010000:00080000:1.0:1787364800.056362:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbed80 x1874187714053632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364800.056372:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714053632:0@lo:400: 00000100:00100000:1.0:1787364800.056409:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714053888 00000100:00100000:1.0:1787364800.056413:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714053888 00000100:00100000:1.0:1787364800.056443:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787364800.056451:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:7645:x1874187714053888:12345-0@lo:253: 20000000:01000000:1.0:1787364800.056481:0:5849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1787364800.056776:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1874187714054016:12345-0@lo:901: Request processed in 803us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364800.056812:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787364800.056833:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364800.056845:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787364800.057660:0:7658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffce680 x1874187714054016/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787364816 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364800.057673:0:7658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffce680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7658:1874187714054016:0@lo:901: 20000000:01000000:1.0:1787364800.057900:0:5849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787364800.058482:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbe680 x1874187714053504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364800.060572:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714053504:0@lo:400: 20000000:01000000:0.0:1787364800.095948:0:5849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787364800.095979:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787364800.096081:0:5872:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787364800.096088:0:5872:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787364800.096125:0:5872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364800.096149:0:5872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364800.096160:0:5872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364800.096220:0:5872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364800.096238:0:5872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 14 pid: 5850 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364800.096283:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffce680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874187714054144:0@lo:104: 00000100:00100000:3.0:1787364800.096376:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364800.096524:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714054144 00000100:00100000:3.0:1787364800.096529:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c55180 going to sleep for 11 seconds 00000100:00100000:2.0:1787364800.096534:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714054144 00000100:00100000:2.0:1787364800.096607:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787364800.096620:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5872:x1874187714054144:12345-0@lo:104: 00010000:00010000:2.0:1787364800.096637:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.096712:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787364800.096729:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:5872:x1874187714054144:12345-0@lo:104: Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364800.096738:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787364800.096763:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787364800.096770:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.096814:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334200 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:2.0:1787364800.096820:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.096829:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787364800.096836:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364800.096841:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffce680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5872:1874187714054144:0@lo:104: 10000000:01000000:2.0:1787364800.096842:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787364800.096866:0:5872:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.096882:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.096889:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787364800.096926:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.096934:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d28334200/0xcfc9272e5fc2acff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.096957:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364800.096959:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364800.096961:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364800.096989:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714054272:0@lo:103: 00000100:00100000:0.0:1787364800.097032:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364800.097379:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714054272 00000100:00100000:2.0:1787364800.097385:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714054272 00010000:00010000:2.0:1787364800.097409:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 15 pid: 5850 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364800.097442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787364800.097451:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:3314:x1874187714054272:12345-0@lo:103: 00010000:00010000:2.0:1787364800.097475:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364800.097482:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 15 pid: 5850 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097494:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 15 pid: 5850 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097511:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2ad06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2acff expref: 15 pid: 5850 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097537:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097546:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787364800.097575:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001489009s 00010000:00010000:2.0:1787364800.097580:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097588:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097595:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097601:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097609:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364800.097614:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.097622:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364800.099961:0:5872:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364800.099987:0:5872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.100254:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.100268:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2adb5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364800.100304:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364800.100690:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:3314:x1874187714054272:12345-0@lo:103: Request processed in 3234us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364800.100703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787364800.101045:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714054272:0@lo:103: 00000100:00100000:1.0:1787364800.115001:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:7645:x1874187714053888:12345-0@lo:253: Request processed in 58534us (69877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364800.115021:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787364800.115140:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8853f36b-eb15-4321-aed5-724dfa11fdc2:7645:1874187714053888:0@lo:253: 10000000:01000000:0.0:1787364800.115164:0:7645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787364800.115168:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787364800.115170:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787364800.115171:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787364800.115173:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787364800.115174:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787364800.115190:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787364800.115192:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787364800.115193:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787364800.115195:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787364800.115198:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787364800.115199:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787364800.115294:0:7645:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787364800.123370:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364800.124009:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787364800.124657:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364800.125092:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787364800.125732:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787364800.126320:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787364800.130652:0:7645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787364800.467878:0:7645:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787364800.467891:0:7645:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787364800.467942:0:7645:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787364800.468025:0:7645:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787364800.468044:0:7645:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787364800.468085:0:7645:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787364801.039694:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364802.059030:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364803.087580:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364804.107238:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364804.108101:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714054400:0@lo:13: 00000100:00100000:1.0:1787364804.108175:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364804.108243:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714054400 00000100:00100000:2.0:1787364804.108252:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714054400 00000100:00100000:2.0:1787364804.108393:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787364804.108404:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714054400:12345-0@lo:13: 00002000:00000024:2.0:1787364804.108452:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364804.108517:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714054400:12345-0@lo:13: Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364804.108525:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787364804.108552:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfd500 x1874187714054400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364804.108571:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714054400:0@lo:13: 00000100:00080000:3.0:1787364804.111814:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787364805.132625:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364805.133315:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714054912:0@lo:400: 00000100:00100000:2.0:1787364805.133402:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364805.133484:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787364805.133492:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714054528:0@lo:400: 00000100:00100000:2.0:1787364805.133525:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364805.133550:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714055040:0@lo:400: 00000100:00100000:2.0:1787364805.133580:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364805.133618:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714054912 00000100:00100000:2.0:1787364805.133625:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714054912 00000100:00100000:2.0:1787364805.133675:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787364805.133684:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714054912:12345-0@lo:400: 00000100:00100000:2.0:1787364805.133737:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714054912:12345-0@lo:400: Request processed in 53us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364805.133744:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787364805.133769:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714054528 00000100:00100000:2.0:1787364805.133773:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714054528 00000100:00100000:2.0:1787364805.133824:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787364805.133831:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3315:x1874187714054528:12345-0@lo:400: 00000100:00100000:2.0:1787364805.133876:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3315:x1874187714054528:12345-0@lo:400: Request processed in 45us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364805.133883:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787364805.133928:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714055040 00000100:00100000:2.0:1787364805.133932:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714055040 00000100:00100000:2.0:1787364805.133969:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787364805.133977:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714055040:12345-0@lo:400: 00000100:00100000:2.0:1787364805.134009:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714055040:12345-0@lo:400: Request processed in 33us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364805.134015:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787364805.134038:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364805.134066:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714054528:0@lo:400: 00010000:00080000:2.0:1787364805.134083:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd3480 x1874187714055040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364805.134094:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714055040:0@lo:400: 00010000:00080000:2.0:1787364805.134104:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd2680 x1874187714054912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364805.134113:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714054912:0@lo:400: 00000100:00100000:1.0:1787364805.134511:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714054656:0@lo:400: 00000100:00100000:1.0:1787364805.134548:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364805.134585:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364805.134592:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714054784:0@lo:400: 00000100:00100000:1.0:1787364805.134614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364805.134676:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714054656 00000100:00100000:2.0:1787364805.134681:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714054656 00000100:00100000:2.0:1787364805.134745:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714054784 00000100:00100000:2.0:1787364805.134748:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714054784 00000100:00100000:1.0:1787364805.135145:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787364805.135155:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714054656:12345-0@lo:400: 00000100:00100000:1.0:1787364805.135201:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714054656:12345-0@lo:400: Request processed in 47us (651us total) trans 0 rc 0/0 00010000:00080000:0.0:1787364805.135242:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd1c00 x1874187714054656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364805.135255:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714054656:0@lo:400: 00000100:00100000:1.0:1787364805.135800:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787364805.135830:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787364805.135838:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714054784:12345-0@lo:400: 00000100:00100000:1.0:1787364805.135901:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714054784:12345-0@lo:400: Request processed in 63us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364805.135908:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787364805.135947:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd2d80 x1874187714054784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364805.135958:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714054784:0@lo:400: 00000100:00080000:2.0:1787364805.136105:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787364806.155094:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364807.180432:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787364807.674064:0:8000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787364808.206963:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787364808.714864:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787364808.714874:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d055cd000 from 30 10000000:01000000:3.0:1787364808.714879:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787364808.714926:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364808.714939:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364808.714950:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364808.714974:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055168:0@lo:101: 00000100:00100000:3.0:1787364808.715046:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364808.715100:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49780 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.715170:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714055168 00000100:00100000:2.0:1787364808.715179:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714055168 00000100:00100000:2.0:1787364808.715438:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787364808.715447:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714055168:12345-0@lo:101: 00010000:00010000:2.0:1787364808.715462:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364808.715487:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2adbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.715511:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.715521:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.715529:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c9c00, rc 0) 00000100:00100000:2.0:1787364808.715570:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714055168:12345-0@lo:101: Request processed in 124us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.715576:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787364808.720624:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055168:0@lo:101: 00010000:00010000:2.0:1787364808.720657:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.720671:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364808.720758:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055296:0@lo:501: 00000100:00100000:2.0:1787364808.720842:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.720892:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787364808.720939:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714055296 00000100:00100000:1.0:1787364808.720948:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714055296 00000100:00100000:1.0:1787364808.720993:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787364808.721003:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714055296:12345-0@lo:501: 00000100:00100000:1.0:1787364808.721424:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714055296:12345-0@lo:501: Request processed in 422us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364808.721432:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787364808.722822:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055296:0@lo:501: 00000100:00100000:2.0:1787364808.722874:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055424:0@lo:503: 00000100:00100000:2.0:1787364808.722929:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.722963:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787364808.723066:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714055424 00000100:00100000:1.0:1787364808.723071:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714055424 00000100:00100000:1.0:1787364808.723118:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787364808.723127:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714055424:12345-0@lo:503: 00000100:00100000:1.0:1787364808.723530:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714055424:12345-0@lo:503: Request processed in 403us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364808.723539:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787364808.723730:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055424:0@lo:503: 00000100:00100000:1.0:1787364808.724053:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8056:1874187714055552:0@lo:502: 00000100:00100000:1.0:1787364808.724097:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.724133:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.724176:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714055552 00000100:00100000:2.0:1787364808.724181:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714055552 00000100:00100000:2.0:1787364808.724217:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787364808.724225:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:8056:x1874187714055552:12345-0@lo:502: 00000100:00100000:2.0:1787364808.724532:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:8056:x1874187714055552:12345-0@lo:502: Request processed in 307us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.724539:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787364808.724622:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8056:1874187714055552:0@lo:502: 00000100:00100000:1.0:1787364808.724674:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8056:1874187714055680:0@lo:502: 00000100:00100000:1.0:1787364808.724708:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.724731:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.724929:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714055680 00000100:00100000:2.0:1787364808.724934:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714055680 00000100:00100000:2.0:1787364808.724973:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787364808.724981:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:8056:x1874187714055680:12345-0@lo:502: 00000100:00100000:2.0:1787364808.725324:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:8056:x1874187714055680:12345-0@lo:502: Request processed in 343us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.725331:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787364808.725726:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8056:1874187714055680:0@lo:502: 00000040:00080000:1.0:1787364808.725754:0:8056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787364808.726038:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787364808.726061:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787364808.726071:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.726082:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364808.726092:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787364808.726095:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787364808.726098:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787364808.726126:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.726134:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.726150:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364808.726166:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055808:0@lo:101: 00000100:00100000:2.0:1787364808.726203:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.726288:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787364808.726328:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714055808 00000100:00100000:1.0:1787364808.726333:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714055808 00000100:00100000:1.0:1787364808.726378:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787364808.726387:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714055808:12345-0@lo:101: 00010000:00010000:1.0:1787364808.726397:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364808.726419:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2adca expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.726443:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.726453:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.726461:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0e00, rc 0) 00000100:00100000:1.0:1787364808.726504:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714055808:12345-0@lo:101: Request processed in 118us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364808.726510:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787364808.726723:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055808:0@lo:101: 00010000:00010000:2.0:1787364808.726736:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.726744:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364808.726816:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055936:0@lo:501: 00000100:00100000:2.0:1787364808.726840:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.726854:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6540 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.726867:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714055936 00000100:00100000:2.0:1787364808.726870:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714055936 00000100:00100000:2.0:1787364808.726892:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787364808.726897:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714055936:12345-0@lo:501: 00000100:00100000:2.0:1787364808.727215:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714055936:12345-0@lo:501: Request processed in 316us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.727222:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787364808.727758:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714055936:0@lo:501: 00000100:00100000:0.0:1787364808.727816:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714056064:0@lo:503: 00000100:00100000:0.0:1787364808.727862:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.727882:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714056064 00000100:00100000:0.0:1787364808.727883:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40113480 going to sleep for 11 seconds 00000100:00100000:1.0:1787364808.727887:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714056064 00000100:00100000:1.0:1787364808.727919:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787364808.727927:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714056064:12345-0@lo:503: 00000100:00100000:1.0:1787364808.728267:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714056064:12345-0@lo:503: Request processed in 341us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364808.728274:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787364808.729022:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714056064:0@lo:503: 00000100:00100000:3.0:1787364808.732749:0:8057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8057:1874187714056192:0@lo:502: 00000100:00100000:3.0:1787364808.732865:0:8057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364808.732919:0:8057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49240 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.732920:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714056192 00000100:00100000:0.0:1787364808.732930:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714056192 00000100:00100000:0.0:1787364808.733027:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787364808.733039:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:8057:x1874187714056192:12345-0@lo:502: 00000100:00100000:0.0:1787364808.733498:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:8057:x1874187714056192:12345-0@lo:502: Request processed in 460us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.733508:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787364808.733611:0:8057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8057:1874187714056192:0@lo:502: 00000020:01000000:3.0:1787364808.733883:0:8057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787364808.733892:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364808.733895:0:8057:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787364808.733900:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787364808.733902:0:8057:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787364808.733922:0:8057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8057:1874187714056320:0@lo:502: 00000100:00100000:3.0:1787364808.733958:0:8057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364808.733988:0:8057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49240 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.734004:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714056320 00000100:00100000:0.0:1787364808.734011:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714056320 00000100:00100000:0.0:1787364808.734094:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787364808.734106:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:8057:x1874187714056320:12345-0@lo:502: 00000100:00100000:0.0:1787364808.734833:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:8057:x1874187714056320:12345-0@lo:502: Request processed in 728us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.734842:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787364808.734946:0:8057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8057:1874187714056320:0@lo:502: 00000020:01000000:1.0:1787364808.734989:0:8057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787364808.734995:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364808.734997:0:8057:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787364808.735003:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787364808.735272:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787364808.735300:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787364808.735312:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.735325:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364808.735335:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787364808.735339:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d20269000 from 30 10000000:01000000:0.0:1787364808.735341:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787364808.735456:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.735466:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.735477:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364808.735507:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714056448:0@lo:101: 00000100:00100000:0.0:1787364808.735548:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364808.735578:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40113c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.738068:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714056448 00000100:00100000:2.0:1787364808.738083:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714056448 00000100:00100000:2.0:1787364808.738141:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787364808.738692:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714056448:12345-0@lo:101: 00010000:00010000:2.0:1787364808.738724:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364808.739137:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2add8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.741478:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.741502:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.741512:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35000, rc 0) 00000100:00100000:2.0:1787364808.741622:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714056448:12345-0@lo:101: Request processed in 3471us (6072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.741632:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787364808.741888:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714056448:0@lo:101: 00010000:00010000:1.0:1787364808.741917:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.741928:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364808.742019:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714056576:0@lo:501: 00000100:00100000:1.0:1787364808.742066:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.742124:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787364808.742162:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714056576 00000100:00100000:1.0:1787364808.742169:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714056576 00000100:00100000:1.0:1787364808.742226:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787364808.742238:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714056576:12345-0@lo:501: 00000100:00100000:1.0:1787364808.746779:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714056576:12345-0@lo:501: Request processed in 4527us (4696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364808.746816:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787364808.746908:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714056576:0@lo:501: 00000100:00100000:1.0:1787364808.746986:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714056704:0@lo:503: 00000100:00100000:1.0:1787364808.747055:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.747118:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787364808.747147:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714056704 00000100:00100000:1.0:1787364808.747154:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714056704 00000100:00100000:1.0:1787364808.747497:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787364808.747510:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714056704:12345-0@lo:503: 00000100:00100000:1.0:1787364808.747755:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714056704:12345-0@lo:503: Request processed in 248us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364808.747762:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787364808.750692:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714056704:0@lo:503: 00000100:00100000:2.0:1787364808.751626:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8059:1874187714056832:0@lo:502: 00000100:00100000:2.0:1787364808.751718:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.751833:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.752000:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714056832 00000100:00100000:0.0:1787364808.752010:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714056832 00000100:00100000:0.0:1787364808.753884:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787364808.753905:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:8059:x1874187714056832:12345-0@lo:502: 00000100:00100000:0.0:1787364808.754231:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:8059:x1874187714056832:12345-0@lo:502: Request processed in 335us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.754241:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787364808.754273:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8059:1874187714056832:0@lo:502: 00000100:00100000:2.0:1787364808.754354:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8059:1874187714056960:0@lo:502: 00000100:00100000:2.0:1787364808.754490:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.754538:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.754613:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714056960 00000100:00100000:0.0:1787364808.754619:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714056960 00000100:00100000:2.0:1787364808.754687:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787364808.754700:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:8059:x1874187714056960:12345-0@lo:502: 00000100:00100000:2.0:1787364808.754915:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:8059:x1874187714056960:12345-0@lo:502: Request processed in 218us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.754933:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787364808.755122:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8059:1874187714056960:0@lo:502: 00000040:00080000:3.0:1787364808.755147:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787364808.755758:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787364808.756328:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787364808.756354:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.756369:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364808.756381:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787364808.756384:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6d20269000 from 5 10000000:01000000:1.0:1787364808.756387:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787364808.756431:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.756439:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.756450:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364808.756475:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057088:0@lo:101: 00000100:00100000:1.0:1787364808.756542:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.756598:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d04a6d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.757854:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714057088 00000100:00100000:0.0:1787364808.757869:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714057088 00000100:00100000:0.0:1787364808.757928:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787364808.757939:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714057088:12345-0@lo:101: 00010000:00010000:0.0:1787364808.757959:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364808.757979:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00030400/0xcfc9272e5fc2aded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ade6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.758005:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030400/0xcfc9272e5fc2aded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ade6 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.758016:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00030400/0xcfc9272e5fc2aded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ade6 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.758026:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030400, rc 0) 00000100:00100000:0.0:1787364808.758114:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714057088:12345-0@lo:101: Request processed in 177us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.758122:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787364808.758402:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057088:0@lo:101: 00010000:00010000:1.0:1787364808.758428:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.758437:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364808.758492:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057216:0@lo:256: 00000100:00100000:1.0:1787364808.758528:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.758567:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d04a6d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.758634:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714057216 00000100:00100000:2.0:1787364808.758639:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714057216 00000100:00100000:2.0:1787364808.758763:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787364808.758773:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714057216:12345-0@lo:256: 20000000:01000000:2.0:1787364808.758811:0:5851:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787364808.758829:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787364808.758832:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787364808.758929:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714057216:12345-0@lo:256: Request processed in 158us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.758936:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787364808.759095:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057216:0@lo:256: 10000000:01000000:1.0:1787364808.759163:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787364808.759172:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.759182:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364808.759191:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787364808.759194:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787364808.759196:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787364808.759222:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.759230:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.759239:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364808.759264:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057344:0@lo:101: 00000100:00100000:1.0:1787364808.759289:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.759310:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d04a6d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.759378:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714057344 00000100:00100000:0.0:1787364808.759383:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714057344 00000100:00100000:0.0:1787364808.759416:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787364808.759424:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714057344:12345-0@lo:101: 00010000:00010000:0.0:1787364808.759433:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364808.759446:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2adf4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.759466:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.759476:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364808.759484:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:0.0:1787364808.759515:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714057344:12345-0@lo:101: Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.759521:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787364808.759593:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057344:0@lo:101: 00010000:00010000:1.0:1787364808.759605:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364808.759612:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364808.760111:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057472:0@lo:501: 00000100:00100000:1.0:1787364808.760140:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.760250:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d04a6d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.760284:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714057472 00000100:00100000:0.0:1787364808.760290:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714057472 00000100:00100000:0.0:1787364808.760325:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787364808.760332:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714057472:12345-0@lo:501: 00000100:00100000:0.0:1787364808.760627:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714057472:12345-0@lo:501: Request processed in 294us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.760634:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787364808.760920:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057472:0@lo:501: 00000100:00100000:2.0:1787364808.760969:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057600:0@lo:503: 00000100:00100000:2.0:1787364808.761008:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.761038:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.761057:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714057600 00000100:00100000:0.0:1787364808.761068:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714057600 00000100:00100000:0.0:1787364808.761281:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787364808.761290:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714057600:12345-0@lo:503: 00000100:00100000:0.0:1787364808.761643:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714057600:12345-0@lo:503: Request processed in 353us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.761650:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787364808.761929:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714057600:0@lo:503: 00000100:00100000:3.0:1787364808.762492:0:8061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8061:1874187714057728:0@lo:502: 00000100:00100000:3.0:1787364808.762533:0:8061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364808.762567:0:8061:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49540 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.762814:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714057728 00000100:00100000:0.0:1787364808.762820:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714057728 00000100:00100000:0.0:1787364808.762898:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787364808.762909:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8061:x1874187714057728:12345-0@lo:502: 00000100:00100000:0.0:1787364808.763352:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8061:x1874187714057728:12345-0@lo:502: Request processed in 434us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.763360:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787364808.763435:0:8061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8061:1874187714057728:0@lo:502: 00000020:01000000:3.0:1787364808.763466:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787364808.763475:0:8061:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787364808.763482:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364808.763485:0:8061:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787364808.763490:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787364808.763495:0:8061:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.102@tcp to nid 0x20000c0a8cc66 (192.168.204.102@tcp) 00000020:01000000:3.0:1787364808.763520:0:8061:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787364808.763524:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787364808.763542:0:8061:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b6d344819b8) 00000020:00000080:3.0:1787364808.763567:0:8061:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787364808.763572:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787364808.763830:0:8061:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787364808.763836:0:8061:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787364808.763845:0:8061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2ae09 00010000:00080000:3.0:1787364808.763882:0:8061:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d20568800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.102@tcp at head 00010000:00010000:3.0:1787364808.764111:0:8061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787364808.764548:0:8061:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787364808.764563:0:8061:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787364808.765376:0:8061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787364808.765588:0:8061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787364808.765638:0:8061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787364808.769263:0:8061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787364808.770020:0:8063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787364808.770026:0:8063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787364808.770726:0:8061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787364808.770824:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787364808.770865:0:8061:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787364808.770895:0:8061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2ae10 00000100:00080000:2.0:1787364808.770909:0:8061:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787364808.770916:0:8061:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d20568800 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:2.0:1787364808.770964:0:8061:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d04fd3100 x1874187714057856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787364808.770986:0:8061:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787364808.771044:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714057856:0@lo:8: 00000100:00100000:0.0:1787364808.771124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787364808.771369:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787364808.771374:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787364808.771381:0:8061:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787364808.771384:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787364808.771389:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787364808.771390:0:8061:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787364808.771393:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787364808.771395:0:8061:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787364808.771417:0:8061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8061:1874187714058368:0@lo:502: 00000100:00100000:3.0:1787364808.771419:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714057984:0@lo:400: 00000100:00100000:0.0:1787364808.771845:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714057856 00000100:00100000:0.0:1787364808.771852:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714057856 00000100:00100000:0.0:1787364808.771888:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787364808.771896:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1874187714057856:12345-0@lo:8: 00010000:00080000:0.0:1787364808.771920:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:0.0:1787364808.771946:0:6710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2ae17 00002000:00100000:0.0:1787364808.771960:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b6d0634b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787364808.771964:0:6710:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787364808.771968:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787364808.772295:0:6710:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787364808.772460:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787364808.772484:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9b6d0634a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787364808.773393:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714058496:0@lo:400: 00000100:00100000:3.0:1787364808.773545:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.773545:0:8061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364808.773602:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787364808.773609:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714058112:0@lo:400: 00000100:00100000:0.0:1787364808.773618:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874187714057856:12345-0@lo:8: Request processed in 1722us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.773627:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787364808.773637:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364808.773666:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714058240:0@lo:400: 00000100:00100000:3.0:1787364808.773691:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364808.773721:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714057984 00000100:00100000:3.0:1787364808.773726:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714057984 00000100:00100000:3.0:1787364808.773761:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714058112 00000100:00100000:3.0:1787364808.773777:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714058112 00000100:00100000:3.0:1787364808.773816:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787364808.773823:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714057984:12345-0@lo:400: 00010000:00080000:0.0:1787364808.773828:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd3100 x1874187714057856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787364818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364808.773838:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787364808.773847:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787364808.773855:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787364808.773860:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:3.0:1787364808.773863:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714057984:12345-0@lo:400: Request processed in 41us (320us total) trans 0 rc 0/0 00000100:00080000:0.0:1787364808.773863:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d20568800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787364808.773869:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1787364808.773874:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787364808.773879:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714057856:0@lo:8: 00000100:00100000:3.0:1787364808.773881:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787364808.773886:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714058112:12345-0@lo:400: 00000004:00080000:0.0:1787364808.773903:0:8063:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787364808.773923:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714058112:12345-0@lo:400: Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364808.773929:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787364808.773947:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714058240 00000100:00100000:3.0:1787364808.773950:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714058240 00000100:00100000:3.0:1787364808.773973:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787364808.773979:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714058240:12345-0@lo:400: 00000100:00100000:3.0:1787364808.774009:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714058240:12345-0@lo:400: Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364808.774015:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:0.0:1787364808.774017:0:8063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 255003231304ns, next at 0ns, rc = 0 00000100:00080000:3.0:1787364808.774028:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787364808.774032:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787364808.774047:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffcdf80 x1874187714058112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364808.774056:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714058112:0@lo:400: 00010000:00080000:3.0:1787364808.774066:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffcf100 x1874187714057984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364808.774073:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714057984:0@lo:400: 00010000:00080000:3.0:1787364808.774094:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffcc700 x1874187714058240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364808.774102:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714058240:0@lo:400: 00000100:00100000:2.0:1787364808.774829:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714058368 00000100:00100000:2.0:1787364808.774835:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714058368 00000100:00100000:2.0:1787364808.774864:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787364808.774872:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8061:x1874187714058368:12345-0@lo:502: 00000100:00100000:2.0:1787364808.775080:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8061:x1874187714058368:12345-0@lo:502: Request processed in 209us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.775087:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787364808.777122:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.777423:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714058496 00000100:00100000:1.0:1787364808.777430:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714058496 00000100:00100000:2.0:1787364808.777500:0:8061:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787364808.777502:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787364808.777512:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714058496:12345-0@lo:400: 00000100:00100000:2.0:1787364808.777527:0:8061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8061:1874187714058368:0@lo:502: 00000100:00100000:1.0:1787364808.777560:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714058496:12345-0@lo:400: Request processed in 51us (443us total) trans 0 rc 0/0 00000020:01000000:2.0:1787364808.777563:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1787364808.777567:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:00000080:2.0:1787364808.777570:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787364808.777572:0:8061:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787364808.777576:0:8061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00080000:1.0:1787364808.777607:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787364808.777631:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffcca80 x1874187714058496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:2.0:1787364808.777632:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:1.0:1787364808.777642:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714058496:0@lo:400: 10000000:01000000:2.0:1787364808.777650:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787364808.779263:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.779280:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364808.779292:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787364808.779301:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d04f519b8 from 1 10000000:01000000:2.0:1787364808.779305:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787364808.779364:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.779374:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.779386:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364808.779411:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714058624:0@lo:101: 00000100:00100000:2.0:1787364808.779473:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.779512:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.779534:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714058624 00000100:00100000:2.0:1787364808.779540:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714058624 00000100:00100000:2.0:1787364808.779583:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787364808.779592:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714058624:12345-0@lo:101: 00010000:00010000:2.0:1787364808.779606:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364808.779621:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ae1e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.779648:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.779676:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.779685:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35c00, rc 0) 00000100:00100000:2.0:1787364808.779723:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714058624:12345-0@lo:101: Request processed in 131us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.779747:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787364808.779825:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714058624:0@lo:101: 00010000:00010000:2.0:1787364808.779841:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.779851:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364808.779908:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714058752:0@lo:501: 00000100:00100000:2.0:1787364808.779933:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.779947:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.779960:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714058752 00000100:00100000:2.0:1787364808.779963:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714058752 00000100:00100000:2.0:1787364808.779985:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787364808.779991:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714058752:12345-0@lo:501: 00000100:00100000:2.0:1787364808.780211:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714058752:12345-0@lo:501: Request processed in 219us (276us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787364808.780218:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787364808.780536:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714058752:0@lo:501: 10000000:01000000:2.0:1787364808.780562:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787364808.780569:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364808.780576:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787364808.830083:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787364808.874976:0:8064:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787364808.874985:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714058880:0@lo:13: 00000100:00100000:1.0:1787364808.875002:0:8064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1874187714059008:0@lo:7: 00000100:00100000:1.0:1787364808.875065:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364808.875067:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.875136:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714059008 00000100:00100000:3.0:1787364808.875144:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714058880 00000100:00100000:3.0:1787364808.875151:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714058880 00000100:00100000:2.0:1787364808.875151:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714059008 00000100:00100000:2.0:1787364808.875212:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787364808.875216:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787364808.875223:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8064:x1874187714059008:12345-0@lo:7: 00000100:00100000:3.0:1787364808.875229:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714058880:12345-0@lo:13: 00002000:00000024:3.0:1787364808.875259:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787364808.875311:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714058880:12345-0@lo:13: Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364808.875319:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787364808.875384:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbce00 x1874187714058880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364808.875401:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714058880:0@lo:13: 00000100:00100000:1.0:1787364808.875746:0:8064:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6480 going to sleep for 11 seconds 00000100:00080000:3.0:1787364808.875992:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787364808.879111:0:6707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787364808.879120:0:6707:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787364808.879279:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8064:x1874187714059008:12345-0@lo:7: Request processed in 4055us (4212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364808.879290:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787364808.879392:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbea00 x1874187714059008/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787364824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364808.879408:0:8064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1874187714059008:0@lo:7: 00000004:00080000:1.0:1787364808.879421:0:8064:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787364808.879459:0:8064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1874187714059136:0@lo:5: 00000100:00100000:1.0:1787364808.879491:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.879558:0:8064:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.879592:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714059136 00000100:00100000:2.0:1787364808.879597:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714059136 00000100:00100000:2.0:1787364808.879639:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787364808.879648:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8064:x1874187714059136:12345-0@lo:5: 00002000:00080000:2.0:1787364808.879669:0:6709:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787364808.879673:0:6709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787364808.881085:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8064:x1874187714059136:12345-0@lo:5: Request processed in 1434us (1589us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787364808.881095:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787364808.881205:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbea00 x1874187714059136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787364824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364808.881221:0:8064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1874187714059136:0@lo:5: 00000004:00080000:1.0:1787364808.881235:0:8064:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787364808.881270:0:8064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1874187714059264:0@lo:700: 00000100:00100000:1.0:1787364808.881302:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364808.881372:0:8064:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787364808.881408:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714059264 00000100:00100000:2.0:1787364808.881414:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714059264 00000100:00100000:2.0:1787364808.881482:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787364808.881490:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8064:x1874187714059264:12345-0@lo:700: 00000100:00100000:2.0:1787364808.881519:0:6932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6932:1874187714059392:0@lo:700: 00000100:00100000:2.0:1787364808.881545:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364808.881562:0:6932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40113e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364808.881961:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714059392 00000100:00100000:0.0:1787364808.881967:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714059392 00000100:00100000:0.0:1787364808.882067:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787364808.882077:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6932:x1874187714059392:12345-0@lo:700: 40000000:02000000:0.0:1787364808.952073:0:5863:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787364808.956219:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6932:x1874187714059392:12345-0@lo:700: Request processed in 74135us (74665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364808.956234:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787364808.956331:0:6932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd0700 x1874187714059392/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787364824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364808.956360:0:6932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6932:1874187714059392:0@lo:700: 40000000:02000000:2.0:1787364808.956373:0:6932:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1787364809.011828:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787364809.011853:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1787364809.011957:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8064:x1874187714059264:12345-0@lo:700: Request processed in 130461us (130647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364809.011971:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787364809.012094:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbce00 x1874187714059264/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787364824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364809.012106:0:8064:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787364809.012125:0:8064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1874187714059264:0@lo:700: 00000004:02000040:1.0:1787364809.034368:0:8064:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787364809.039061:0:8064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1874187714059520:0@lo:5: 00000100:00100000:2.0:1787364809.039180:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364809.039286:0:8064:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18830180 going to sleep for 11 seconds 00000100:00100000:3.0:1787364809.039453:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714059520 00000100:00100000:3.0:1787364809.039463:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714059520 00000100:00100000:3.0:1787364809.039536:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787364809.039548:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8064:x1874187714059520:12345-0@lo:5: 00002000:00080000:2.0:1787364809.049311:0:6707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787364809.049458:0:6707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:0.0:1787364809.054538:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd0700 x1874187714059520/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787364825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364809.054567:0:8064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1874187714059520:0@lo:5: 00000004:00080000:0.0:1787364809.054584:0:8064:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1787364809.056057:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8064:x1874187714059520:12345-0@lo:5: Request processed in 14935us (15301us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787364809.056079:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787364809.229754:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364809.229807:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714059648:0@lo:13: 00000100:00100000:0.0:1787364809.229880:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364809.229955:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714059648 00000100:00100000:0.0:1787364809.229963:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714059648 00000100:00100000:0.0:1787364809.230007:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787364809.230017:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714059648:12345-0@lo:13: 00002000:00000024:0.0:1787364809.230051:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364809.230096:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714059648:12345-0@lo:13: Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364809.230103:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787364809.230145:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfd500 x1874187714059648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364809.230165:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714059648:0@lo:13: 00010000:00010000:0.0:1787364809.230992:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364810.251869:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364811.275383:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364812.306255:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787364813.308336:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787364813.327220:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364813.835014:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714059904:0@lo:400: 00000100:00100000:0.0:1787364813.835086:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364813.835139:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714060416:0@lo:400: 00000100:00100000:0.0:1787364813.835166:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364813.835198:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787364813.835204:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714059776:0@lo:400: 00000100:00100000:0.0:1787364813.835252:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364813.835284:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714060288:0@lo:400: 00000100:00100000:0.0:1787364813.835306:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364813.835331:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714060032:0@lo:400: 00000100:00100000:0.0:1787364813.835353:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364813.835371:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364813.835376:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714060160:0@lo:400: 00000100:00100000:0.0:1787364813.835395:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364813.835425:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714059904 00000100:00100000:0.0:1787364813.835432:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714059904 00000100:00100000:0.0:1787364813.835466:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714060288 00000100:00100000:0.0:1787364813.835469:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714060288 00000100:00100000:0.0:1787364813.835507:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714060032 00000100:00100000:0.0:1787364813.835510:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714060032 00000100:00100000:0.0:1787364813.835523:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787364813.835530:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714059904:12345-0@lo:400: 00000100:00100000:0.0:1787364813.835575:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714059904:12345-0@lo:400: Request processed in 45us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364813.835581:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787364813.835596:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787364813.835601:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714060288:12345-0@lo:400: 00000100:00100000:0.0:1787364813.835623:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714060288:12345-0@lo:400: Request processed in 22us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364813.835628:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787364813.835636:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787364813.835641:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714060032:12345-0@lo:400: 00000100:00100000:0.0:1787364813.835666:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714060032:12345-0@lo:400: Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364813.835683:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787364813.835702:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714060416 00000100:00100000:0.0:1787364813.835705:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714060416 00000100:00100000:0.0:1787364813.835729:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714060160 00000100:00100000:0.0:1787364813.835731:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714060160 00000100:00100000:0.0:1787364813.835744:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787364813.835750:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714060416:12345-0@lo:400: 00000100:00100000:0.0:1787364813.835778:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714060416:12345-0@lo:400: Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364813.835808:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787364813.835819:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787364813.835824:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714060160:12345-0@lo:400: 00000100:00100000:0.0:1787364813.835850:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714060160:12345-0@lo:400: Request processed in 26us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364813.835855:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787364813.835895:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfce00 x1874187714060288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364813.835909:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714060288:0@lo:400: 00010000:00080000:0.0:1787364813.835920:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dff100 x1874187714059904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364813.835929:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714059904:0@lo:400: 00010000:00080000:0.0:1787364813.835938:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfdc00 x1874187714060416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364813.835945:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787364813.835959:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714060416:0@lo:400: 00010000:00080000:0.0:1787364813.835995:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfc700 x1874187714060160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364813.836003:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714060160:0@lo:400: 00010000:00080000:0.0:1787364813.836011:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfca80 x1874187714060032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787364829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364813.836019:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714060032:0@lo:400: 00000100:00100000:2.0:1787364813.842054:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714059776 00000100:00100000:2.0:1787364813.842070:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714059776 00000100:00100000:2.0:1787364813.842133:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787364813.842145:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714059776:12345-0@lo:400: 00000100:00100000:2.0:1787364813.843008:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714059776:12345-0@lo:400: Request processed in 860us (7764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364813.843021:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787364813.844130:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714059776:0@lo:400: 00000100:00080000:3.0:1787364813.844576:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787364813.844583:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787364813.844587:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364814.347044:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787364814.347072:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714060544:0@lo:13: 00000100:00100000:3.0:1787364814.347145:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364814.347210:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714060544 00000100:00100000:3.0:1787364814.347245:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714060544 00000100:00100000:3.0:1787364814.347293:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787364814.347302:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714060544:12345-0@lo:13: 00002000:00000024:3.0:1787364814.347349:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364814.347391:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714060544:12345-0@lo:13: Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364814.347398:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787364814.347435:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33f02d80 x1874187714060544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364814.347453:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714060544:0@lo:13: 00010000:00010000:3.0:1787364814.348078:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364814.348512:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364814.348525:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714060672:0@lo:13: 00000100:00100000:0.0:1787364814.348572:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364814.349530:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714060672 00000100:00100000:3.0:1787364814.349539:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714060672 00000100:00100000:3.0:1787364814.349588:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787364814.349598:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714060672:12345-0@lo:13: 00002000:00000024:3.0:1787364814.349628:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364814.349703:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714060672:12345-0@lo:13: Request processed in 106us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364814.349711:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787364814.349747:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33f02300 x1874187714060672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364814.349766:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714060672:0@lo:13: 00000100:00100000:0.0:1787364814.878335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364814.878624:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688870272 00000100:00100000:2.0:1787364814.878635:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688870272 00000100:00100000:2.0:1787364814.878702:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 113 00000100:00100000:2.0:1787364814.878710:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2363:x1874187688870272:12345-192.168.204.2@tcp:250: 00010000:00080000:2.0:1787364814.878742:0:5850:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cf99abb4-88a3-48fa-9491-b4225d983398@192.168.204.2@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:2.0:1787364814.878771:0:5850:0:(genops.c:1385:class_connect()) connect: client cf99abb4-88a3-48fa-9491-b4225d983398, cookie 0xcfc9272e5fc2ae2c 00000100:00080000:2.0:1787364814.878938:0:5850:0:(import.c:65:import_set_state_nolock()) ffff9b6c06b0f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787364814.879020:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+5:2363:x1874187688870272:12345-192.168.204.2@tcp:250: Request processed in 308us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364814.879028:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 113 00000100:00100000:3.0:1787364814.883990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364814.884087:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688870144 00000100:00100000:2.0:1787364814.884097:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688870144 00000100:00100000:2.0:1787364814.884163:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 114 00000100:00100000:2.0:1787364814.884174:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+5:5594:x1874187688870144:12345-192.168.204.2@tcp:101: 00010000:00010000:2.0:1787364814.884192:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364814.884221:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da15 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364814.884258:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364814.884269:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364814.884279:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e34800, rc 0) 00000100:00100000:2.0:1787364814.884340:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+6:5594:x1874187688870144:12345-192.168.204.2@tcp:101: Request processed in 167us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364814.884347:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 114 00000100:00100000:3.0:1787364814.891939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364814.892049:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688870400 00000100:00100000:0.0:1787364814.892060:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688870400 00000100:00100000:0.0:1787364814.892122:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 115 00000100:00100000:0.0:1787364814.892133:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+6:5594:x1874187688870400:12345-192.168.204.2@tcp:501: 00000100:00100000:0.0:1787364814.892583:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+6:5594:x1874187688870400:12345-192.168.204.2@tcp:501: Request processed in 450us (654us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787364814.892591:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 115 00000100:00100000:1.0:1787364814.896690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364814.896965:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688870528 00000100:00100000:0.0:1787364814.896974:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688870528 00000100:00100000:0.0:1787364814.897030:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 116 00000100:00100000:0.0:1787364814.897039:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+6:5594:x1874187688870528:12345-192.168.204.2@tcp:101: 00010000:00010000:0.0:1787364814.897055:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364814.897074:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da1c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364814.897106:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364814.897132:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364814.897144:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030200, rc 0) 00000100:00100000:0.0:1787364814.897203:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+7:5594:x1874187688870528:12345-192.168.204.2@tcp:101: Request processed in 165us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364814.897211:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 116 00000100:00100000:3.0:1787364814.918722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364814.918940:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688870656 00000100:00100000:0.0:1787364814.918950:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688870656 00000100:00100000:0.0:1787364814.919010:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 117 00000100:00100000:0.0:1787364814.919021:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+7:5594:x1874187688870656:12345-192.168.204.2@tcp:501: 00000100:00100000:0.0:1787364814.919474:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+8:5594:x1874187688870656:12345-192.168.204.2@tcp:501: Request processed in 452us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364814.919482:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 117 00000100:00100000:3.0:1787364814.924151:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364814.930580:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688870784 00000100:00100000:2.0:1787364814.930612:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688870784 00000100:00100000:2.0:1787364814.930687:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 118 00000100:00100000:2.0:1787364814.930697:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+8:5594:x1874187688870784:12345-192.168.204.2@tcp:503: 00000100:00100000:2.0:1787364814.931115:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+8:5594:x1874187688870784:12345-192.168.204.2@tcp:503: Request processed in 418us (6974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364814.931123:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 118 00000100:00100000:1.0:1787364814.944478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364814.944763:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688870912 00000100:00100000:0.0:1787364814.944774:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688870912 00000100:00100000:0.0:1787364814.944858:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 119 00000100:00100000:0.0:1787364814.944868:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+8:5613:x1874187688870912:12345-192.168.204.2@tcp:502: 00000100:00100000:0.0:1787364814.945221:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+8:5613:x1874187688870912:12345-192.168.204.2@tcp:502: Request processed in 353us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364814.945240:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 119 00000100:00100000:3.0:1787364814.997985:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364814.998099:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688871040 00000100:00100000:0.0:1787364814.998110:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688871040 00000100:00100000:0.0:1787364814.998169:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 120 00000100:00100000:0.0:1787364814.998179:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+8:5613:x1874187688871040:12345-192.168.204.2@tcp:502: 00000100:00100000:0.0:1787364814.998511:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+8:5613:x1874187688871040:12345-192.168.204.2@tcp:502: Request processed in 332us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364814.998519:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 120 00000100:00100000:3.0:1787364815.004707:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364815.004871:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688871168 00000100:00100000:2.0:1787364815.004881:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688871168 00000100:00100000:2.0:1787364815.004943:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 121 00000100:00100000:2.0:1787364815.004953:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+8:5594:x1874187688871168:12345-192.168.204.2@tcp:101: 00010000:00010000:2.0:1787364815.004971:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364815.004990:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e34c00/0xcfc9272e5fc2ae41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364815.005021:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e34c00/0xcfc9272e5fc2ae41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da46 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364815.005033:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e34c00/0xcfc9272e5fc2ae41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da46 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364815.005042:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e34c00, rc 0) 00000100:00100000:2.0:1787364815.005102:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+9:5594:x1874187688871168:12345-192.168.204.2@tcp:101: Request processed in 150us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364815.005109:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 121 00000100:00100000:1.0:1787364815.028095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364815.028189:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688871296 00000100:00100000:2.0:1787364815.028199:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688871296 00000100:00100000:2.0:1787364815.028290:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 122 00000100:00100000:2.0:1787364815.028300:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+9:5594:x1874187688871296:12345-192.168.204.2@tcp:256: 20000000:01000000:2.0:1787364815.028356:0:5851:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787364815.028377:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787364815.028381:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787364815.028384:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787364815.028386:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787364815.040751:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+9:5594:x1874187688871296:12345-192.168.204.2@tcp:256: Request processed in 12438us (12653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364815.040768:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 122 00000100:00100000:3.0:1787364815.048707:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364815.048992:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688871424 00000100:00100000:0.0:1787364815.049003:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688871424 00000100:00100000:0.0:1787364815.049064:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 123 00000100:00100000:0.0:1787364815.049075:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+9:5594:x1874187688871424:12345-192.168.204.2@tcp:101: 00010000:00010000:0.0:1787364815.049092:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364815.049113:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da4d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364815.049142:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364815.049153:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364815.049163:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030600, rc 0) 00000100:00100000:0.0:1787364815.049235:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:5594:x1874187688871424:12345-192.168.204.2@tcp:101: Request processed in 161us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364815.049242:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 123 00000100:00100000:1.0:1787364815.055901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364815.056328:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688871552 00000100:00100000:2.0:1787364815.056337:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688871552 00000100:00100000:2.0:1787364815.056393:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 124 00000100:00100000:2.0:1787364815.056402:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:5594:x1874187688871552:12345-192.168.204.2@tcp:501: 00000100:00100000:2.0:1787364815.059025:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:5594:x1874187688871552:12345-192.168.204.2@tcp:501: Request processed in 2614us (3124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364815.059070:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 124 00000100:00100000:3.0:1787364815.063021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364815.068153:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688871680 00000100:00100000:2.0:1787364815.068169:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688871680 00000100:00100000:2.0:1787364815.068255:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 125 00000100:00100000:2.0:1787364815.068266:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:5594:x1874187688871680:12345-192.168.204.2@tcp:503: 00000100:00100000:2.0:1787364815.068706:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:5594:x1874187688871680:12345-192.168.204.2@tcp:503: Request processed in 440us (5755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364815.068715:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 125 00000100:00100000:3.0:1787364815.075277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364815.077987:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688871808 00000100:00100000:2.0:1787364815.078005:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688871808 00000100:00100000:2.0:1787364815.078080:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 126 00000100:00100000:2.0:1787364815.078091:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:5617:x1874187688871808:12345-192.168.204.2@tcp:502: 00000100:00100000:2.0:1787364815.078411:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:5617:x1874187688871808:12345-192.168.204.2@tcp:502: Request processed in 322us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364815.078420:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 126 00000100:00100000:1.0:1787364815.095869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364815.095986:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688871936 00000100:00100000:0.0:1787364815.095996:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688871936 00000100:00100000:0.0:1787364815.096055:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 127 00000100:00100000:0.0:1787364815.096066:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:5617:x1874187688871936:12345-192.168.204.2@tcp:502: 00000100:00100000:0.0:1787364815.096310:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:5617:x1874187688871936:12345-192.168.204.2@tcp:502: Request processed in 246us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364815.096325:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 127 00000100:00100000:1.0:1787364815.100702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364815.100782:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688872064 00000100:00100000:0.0:1787364815.100815:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688872064 00000100:00100000:0.0:1787364815.100867:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:0.0:1787364815.100876:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2363:x1874187688872064:12345-192.168.204.2@tcp:38: 00010000:00080000:0.0:1787364815.100905:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:0.0:1787364815.100951:0:5856:0:(genops.c:1385:class_connect()) connect: client 6b97b2b3-6991-434b-88a0-aee779536483, cookie 0xcfc9272e5fc2ae4f 00000004:00100000:0.0:1787364815.100980:0:5856:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787364815.100986:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787364815.195132:0:5856:0:(import.c:65:import_set_state_nolock()) ffff9b6c06f86800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787364815.195455:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2363:x1874187688872064:12345-192.168.204.2@tcp:38: Request processed in 94574us (94757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364815.195473:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 4 00010000:00010000:1.0:1787364815.371160:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364816.221184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364816.221241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364816.221339:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688872192 00000100:00100000:2.0:1787364816.221349:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688872192 00000100:00100000:2.0:1787364816.221418:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688872320 00000100:00100000:2.0:1787364816.221422:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688872320 00000100:00100000:2.0:1787364816.221439:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:2.0:1787364816.221449:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:0:x1874187688872192:12345-192.168.204.2@tcp:41: 00000004:00000024:2.0:1787364816.221493:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787364816.221563:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:0:x1874187688872192:12345-192.168.204.2@tcp:41: Request processed in 115us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364816.221571:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:2.0:1787364816.221589:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:2.0:1787364816.221595:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:5594:x1874187688872320:12345-192.168.204.2@tcp:41: 00000004:00000024:2.0:1787364816.221605:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787364816.221625:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:5594:x1874187688872320:12345-192.168.204.2@tcp:41: Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364816.221631:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00080000:3.0:1787364816.222391:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364816.232533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364816.232851:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688872448 00000100:00100000:2.0:1787364816.232862:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688872448 00000100:00100000:2.0:1787364816.232926:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:2.0:1787364816.232937:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:5594:x1874187688872448:12345-192.168.204.2@tcp:40: 00000100:00100000:2.0:1787364816.233033:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:5594:x1874187688872448:12345-192.168.204.2@tcp:40: Request processed in 97us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364816.233041:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787364816.241899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364816.241935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364816.241948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364816.241979:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364816.242059:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688872576 00000100:00100000:0.0:1787364816.242069:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688872576 00000100:00100000:0.0:1787364816.242116:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688872704 00000100:00100000:0.0:1787364816.242120:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688872704 00000100:00100000:0.0:1787364816.242135:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:0.0:1787364816.242143:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1874187688872576:12345-192.168.204.2@tcp:8: 00010000:00080000:0.0:1787364816.242173:0:6709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:0.0:1787364816.242225:0:6709:0:(genops.c:1385:class_connect()) connect: client 6b97b2b3-6991-434b-88a0-aee779536483, cookie 0xcfc9272e5fc2ae56 00002000:00100000:0.0:1787364816.242237:0:6709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6b97b2b3-6991-434b-88a0-aee779536483/ffff9b6d35513800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787364816.242259:0:6709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787364816.242640:0:6709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787364816.242671:0:6709:0:(import.c:65:import_set_state_nolock()) ffff9b6d35510000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787364816.242756:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2363:x1874187688872576:12345-192.168.204.2@tcp:8: Request processed in 613us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364816.242764:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:0.0:1787364816.242781:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:0.0:1787364816.242819:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1874187688872704:12345-192.168.204.2@tcp:8: 00010000:00080000:0.0:1787364816.242836:0:6709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:0.0:1787364816.242855:0:6709:0:(genops.c:1385:class_connect()) connect: client 6b97b2b3-6991-434b-88a0-aee779536483, cookie 0xcfc9272e5fc2ae5d 00002000:00100000:0.0:1787364816.242861:0:6709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6b97b2b3-6991-434b-88a0-aee779536483/ffff9b6d06377800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787364816.242875:0:6709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787364816.243087:0:6709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787364816.243104:0:6709:0:(import.c:65:import_set_state_nolock()) ffff9b6d06370800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787364816.243130:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2363:x1874187688872704:12345-192.168.204.2@tcp:8: Request processed in 343us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364816.243136:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:0.0:1787364816.243271:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688872960 00000100:00100000:0.0:1787364816.243277:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688872960 00000100:00100000:0.0:1787364816.243308:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 128 00000100:00100000:0.0:1787364816.243315:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688872960:12345-192.168.204.2@tcp:400: 00000100:00100000:0.0:1787364816.243347:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688872960:12345-192.168.204.2@tcp:400: Request processed in 33us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364816.243354:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 128 00000100:00100000:2.0:1787364816.244017:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688872832 00000100:00100000:2.0:1787364816.244023:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688872832 00000100:00100000:2.0:1787364816.244061:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:2.0:1787364816.244069:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:5594:x1874187688872832:12345-192.168.204.2@tcp:33: 00000004:00080000:2.0:1787364816.296316:0:5859:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 52176us 00000004:00200000:1.0:1787364816.348983:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787364816.349172:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:5594:x1874187688872832:12345-192.168.204.2@tcp:33: Request processed in 105097us (107275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364816.350579:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00010000:00010000:3.0:1787364816.395028:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364816.638637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364816.638754:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688873088 00000100:00100000:2.0:1787364816.638765:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688873088 00000100:00100000:2.0:1787364816.638863:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:2.0:1787364816.638872:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:5634:x1874187688873088:12345-192.168.204.2@tcp:101: 00010000:00010000:2.0:1787364816.638893:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364816.638915:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35400/0xcfc9272e5fc2ae64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da77 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364816.638979:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2ae6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364816.638993:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364816.639007:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364816.639247:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787364816.639252:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364816.639346:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364816.639374:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35400/0xcfc9272e5fc2ae64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da77 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364816.639426:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2ae6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da77 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364816.639435:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364816.639438:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787364816.639441:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35a00, rc 0) 00000100:00100000:2.0:1787364816.639505:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:5634:x1874187688873088:12345-192.168.204.2@tcp:101: Request processed in 634us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364816.639513:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 8 00010000:00010000:1.0:1787364817.420736:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364818.445038:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787364818.526807:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000100:00100000:2.0:1787364818.955207:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714060928:0@lo:400: 00000100:00100000:2.0:1787364818.955293:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364818.955381:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714061440:0@lo:400: 00000100:00100000:0.0:1787364818.955386:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714061056:0@lo:400: 00000100:00100000:2.0:1787364818.955410:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364818.955413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364818.955448:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787364818.955448:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364818.955454:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714060800:0@lo:400: 00000100:00100000:0.0:1787364818.955454:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714061184:0@lo:400: 00000100:00100000:1.0:1787364818.955520:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714060928 00000100:00100000:1.0:1787364818.955541:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714060928 00000100:00100000:1.0:1787364818.955583:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714061056 00000100:00100000:1.0:1787364818.955585:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714061056 00000100:00100000:1.0:1787364818.955609:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787364818.955618:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714060928:12345-0@lo:400: 00000100:00100000:3.0:1787364818.955736:0:5856:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787364818.955746:0:5856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787364818.955855:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714061440 00000100:00100000:3.0:1787364818.955859:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714061440 00000100:00100000:3.0:1787364818.955886:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787364818.955895:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714061440:12345-0@lo:400: 00000100:00100000:0.0:1787364818.963619:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364818.963707:0:6710:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787364818.963717:0:6710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787364818.963874:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714061184 00000100:00100000:0.0:1787364818.963882:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714061184 00000100:00100000:0.0:1787364818.964216:0:6710:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787364818.964227:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787364818.964237:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714061184:12345-0@lo:400: 00000100:00100000:0.0:1787364818.964296:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714061184:12345-0@lo:400: Request processed in 60us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364818.964304:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787364818.964344:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fdd8700 x1874187714061184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364818.964359:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714061184:0@lo:400: 00000100:00080000:0.0:1787364818.964458:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787364818.964463:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787364818.964465:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364818.964476:0:5858:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787364818.964486:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787364818.964494:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714061056:12345-0@lo:400: 00000100:00100000:0.0:1787364818.964537:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714061056:12345-0@lo:400: Request processed in 43us (9122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364818.964543:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787364818.964575:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714061056:0@lo:400: 00000100:00100000:1.0:1787364818.970269:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714060928:12345-0@lo:400: Request processed in 14642us (14976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364818.970286:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787364818.973871:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364818.973939:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714061312:0@lo:400: 00000100:00100000:2.0:1787364818.973981:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364818.974036:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714060928:0@lo:400: 00000100:00100000:0.0:1787364818.974135:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714060800 00000100:00100000:0.0:1787364818.974142:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714060800 00000100:00100000:0.0:1787364818.974226:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787364818.974235:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714060800:12345-0@lo:400: 00000100:00100000:0.0:1787364818.974287:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714060800:12345-0@lo:400: Request processed in 53us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364818.974294:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787364818.974776:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714061312 00000100:00100000:1.0:1787364818.974782:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714061312 00000100:00100000:1.0:1787364818.974861:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787364818.974868:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714061312:12345-0@lo:400: 00000100:00100000:1.0:1787364818.974909:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714061312:12345-0@lo:400: Request processed in 42us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364818.974916:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787364818.975011:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364818.976105:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714060800:0@lo:400: 00000100:00100000:2.0:1787364818.976122:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714061312:0@lo:400: 00000100:00100000:3.0:1787364818.976440:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714061440:12345-0@lo:400: Request processed in 20544us (21026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364818.976450:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787364818.977116:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fddb100 x1874187714061440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364818.977257:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714061440:0@lo:400: 00000100:00100000:3.0:1787364819.019538:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364819.019730:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688873216 00000100:00100000:0.0:1787364819.019740:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688873216 00000100:00100000:0.0:1787364819.019835:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:0.0:1787364819.019845:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:5687:x1874187688873216:12345-192.168.204.2@tcp:41: 00000004:00000024:0.0:1787364819.019893:0:8228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787364819.019965:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:5687:x1874187688873216:12345-192.168.204.2@tcp:41: Request processed in 121us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364819.019973:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00080000:3.0:1787364819.023591:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364819.027890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364819.027994:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688873344 00000100:00100000:0.0:1787364819.028005:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688873344 00000100:00100000:0.0:1787364819.028082:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:0.0:1787364819.028092:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6b97b2b3-6991-434b-88a0-aee779536483+5:5687:x1874187688873344:12345-192.168.204.2@tcp:13: 00002000:00000024:0.0:1787364819.028137:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364819.028221:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6b97b2b3-6991-434b-88a0-aee779536483+5:5687:x1874187688873344:12345-192.168.204.2@tcp:13: Request processed in 130us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364819.028231:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00080000:3.0:1787364819.029632:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787364819.030902:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364819.031321:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688873472 00000100:00100000:0.0:1787364819.031334:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688873472 00000100:00080000:3.0:1787364819.031613:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787364819.034879:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:0.0:1787364819.034911:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6b97b2b3-6991-434b-88a0-aee779536483+6:5687:x1874187688873472:12345-192.168.204.2@tcp:13: 00002000:00000024:0.0:1787364819.034989:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364819.035105:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6b97b2b3-6991-434b-88a0-aee779536483+6:5687:x1874187688873472:12345-192.168.204.2@tcp:13: Request processed in 211us (4214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364819.035116:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00010000:00010000:1.0:1787364819.469709:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364819.470807:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787364819.470846:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714061568:0@lo:13: 00000100:00100000:3.0:1787364819.470955:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364819.471055:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714061568 00000100:00100000:3.0:1787364819.471065:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714061568 00000100:00100000:3.0:1787364819.471152:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787364819.471164:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714061568:12345-0@lo:13: 00000100:00100000:2.0:1787364819.471402:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364819.471415:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714061696:0@lo:13: 00000100:00100000:2.0:1787364819.471454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364819.471668:0:6712:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787364819.471679:0:6712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787364819.471992:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364819.472646:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714061568:12345-0@lo:13: Request processed in 1480us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364819.472658:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787364819.472685:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714061696 00000100:00100000:3.0:1787364819.472693:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714061696 00000100:00100000:3.0:1787364819.472724:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787364819.472733:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714061696:12345-0@lo:13: 00002000:00000024:3.0:1787364819.472750:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364819.472832:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714061696:12345-0@lo:13: Request processed in 100us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364819.472839:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787364819.472885:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfca80 x1874187714061696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364819.472910:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714061696:0@lo:13: 00010000:00080000:0.0:1787364819.484109:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34450700 x1874187714061568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364819.484161:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714061568:0@lo:13: 00000001:00100000:3.0:1787364819.565967:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00010000:00010000:3.0:1787364820.494731:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787364820.559956:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000100:00100000:0.0:1787364821.277916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364821.277965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364821.278372:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688873600 00000100:00100000:2.0:1787364821.278386:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688873600 00000100:00100000:2.0:1787364821.278454:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 130 00000100:00100000:2.0:1787364821.278466:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2367:x1874187688873600:12345-192.168.204.2@tcp:400: 00000100:00100000:2.0:1787364821.278559:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2367:x1874187688873600:12345-192.168.204.2@tcp:400: Request processed in 95us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364821.278568:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 130 00000100:00100000:0.0:1787364821.279716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364821.279757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364821.279814:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688873728 00000100:00100000:0.0:1787364821.279824:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688873728 00000100:00100000:0.0:1787364821.279898:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:0.0:1787364821.279910:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688873728:12345-192.168.204.2@tcp:400: 00000100:00100000:0.0:1787364821.279985:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688873728:12345-192.168.204.2@tcp:400: Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364821.279997:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:0.0:1787364821.280025:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688873856 00000100:00100000:0.0:1787364821.280030:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688873856 00000100:00100000:0.0:1787364821.280061:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688873984 00000100:00100000:0.0:1787364821.280064:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688873984 00000100:00100000:0.0:1787364821.280088:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:0.0:1787364821.280095:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688873856:12345-192.168.204.2@tcp:400: 00000100:00100000:3.0:1787364821.280576:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:3.0:1787364821.280591:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688873984:12345-192.168.204.2@tcp:400: 00000100:00100000:3.0:1787364821.280636:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688873984:12345-192.168.204.2@tcp:400: Request processed in 52us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364821.280645:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00080000:2.0:1787364821.282607:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364821.282619:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364821.282623:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364821.284590:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688873856:12345-192.168.204.2@tcp:400: Request processed in 4484us (6614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364821.284605:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00010000:00010000:1.0:1787364821.516217:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787364822.012256:0:8318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787364822.539102:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364823.566456:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364824.076086:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714062208:0@lo:400: 00000100:00100000:2.0:1787364824.076291:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714061824:0@lo:400: 00000100:00100000:2.0:1787364824.076348:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364824.076403:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714062336:0@lo:400: 00000100:00100000:2.0:1787364824.076431:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364824.076473:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787364824.076480:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714061952:0@lo:400: 00000100:00100000:2.0:1787364824.076503:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364824.076522:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714062464:0@lo:400: 00000100:00100000:2.0:1787364824.076545:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364824.076614:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714061824 00000100:00100000:2.0:1787364824.076623:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714061824 00000100:00100000:2.0:1787364824.076686:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787364824.076695:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714061824:12345-0@lo:400: 00000100:00100000:2.0:1787364824.076772:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714061824:12345-0@lo:400: Request processed in 77us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364824.076780:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787364824.076866:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714061824:0@lo:400: 00000100:00100000:1.0:1787364824.077054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364824.077089:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787364824.077095:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714062080:0@lo:400: 00000100:00100000:1.0:1787364824.077124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364824.077154:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714062336 00000100:00100000:1.0:1787364824.077158:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714062336 00000100:00100000:1.0:1787364824.077475:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714061952 00000100:00100000:1.0:1787364824.077481:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714061952 00000100:00100000:1.0:1787364824.077495:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714062080 00000100:00100000:1.0:1787364824.077497:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714062080 00000100:00100000:1.0:1787364824.077512:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787364824.077519:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714062336:12345-0@lo:400: 00000100:00100000:1.0:1787364824.077563:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714062336:12345-0@lo:400: Request processed in 44us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364824.077570:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787364824.077586:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787364824.077592:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714061952:12345-0@lo:400: 00000100:00100000:1.0:1787364824.077621:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714061952:12345-0@lo:400: Request processed in 30us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364824.077627:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787364824.077639:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787364824.077645:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714062080:12345-0@lo:400: 00000100:00100000:1.0:1787364824.077684:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714062080:12345-0@lo:400: Request processed in 39us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364824.077705:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787364824.077820:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714062464 00000100:00100000:2.0:1787364824.077825:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714062464 00000100:00100000:2.0:1787364824.077859:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714062208 00000100:00100000:2.0:1787364824.077862:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714062208 00000100:00100000:2.0:1787364824.077887:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787364824.077894:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714062464:12345-0@lo:400: 00000100:00100000:2.0:1787364824.077933:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714062464:12345-0@lo:400: Request processed in 39us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364824.077939:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787364824.077950:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787364824.077956:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714062208:12345-0@lo:400: 00000100:00100000:2.0:1787364824.077984:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714062208:12345-0@lo:400: Request processed in 29us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364824.077990:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787364824.078007:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364824.078011:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364824.078014:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364824.078062:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714061952:0@lo:400: 00010000:00080000:2.0:1787364824.078079:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fddad80 x1874187714062464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364824.078098:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714062464:0@lo:400: 00000100:00100000:2.0:1787364824.078111:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714062336:0@lo:400: 00000100:00100000:1.0:1787364824.078930:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714062080:0@lo:400: 00010000:00080000:1.0:1787364824.078946:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fdd9c00 x1874187714062208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364824.078956:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714062208:0@lo:400: 00010000:00010000:3.0:1787364824.587436:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364824.598090:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714062592:0@lo:13: 00000100:00100000:1.0:1787364824.598197:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364824.598292:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364824.598309:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714062720:0@lo:13: 00000100:00100000:1.0:1787364824.598339:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364824.598395:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714062592 00000100:00100000:1.0:1787364824.598404:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714062592 00000100:00100000:1.0:1787364824.598860:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714062720 00000100:00100000:1.0:1787364824.598866:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714062720 00000100:00100000:1.0:1787364824.598889:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787364824.598900:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714062592:12345-0@lo:13: 00002000:00000024:1.0:1787364824.598947:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364824.599115:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787364824.599126:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714062720:12345-0@lo:13: 00002000:00000024:2.0:1787364824.599150:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364824.599182:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714062720:12345-0@lo:13: Request processed in 59us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364824.599189:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787364824.599584:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714062592:12345-0@lo:13: Request processed in 112us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364824.599596:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787364824.599774:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd2300 x1874187714062720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364824.600932:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714062720:0@lo:13: 00010000:00080000:1.0:1787364824.600968:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfce00 x1874187714062592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364824.601013:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714062592:0@lo:13: 00010000:00010000:1.0:1787364825.610962:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364826.394928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364826.395095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364826.395154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364826.395203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364826.395245:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688874496 00000100:00100000:0.0:1787364826.395258:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688874496 00000100:00100000:0.0:1787364826.395335:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688874368 00000100:00100000:0.0:1787364826.395338:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688874368 00000100:00100000:0.0:1787364826.395369:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:0.0:1787364826.395381:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688874496:12345-192.168.204.2@tcp:400: 00000100:00100000:0.0:1787364826.395479:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688874496:12345-192.168.204.2@tcp:400: Request processed in 99us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364826.395488:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:0.0:1787364826.395509:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:0.0:1787364826.395516:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688874368:12345-192.168.204.2@tcp:400: 00000100:00100000:0.0:1787364826.395545:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688874368:12345-192.168.204.2@tcp:400: Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364826.395551:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00080000:0.0:1787364826.395569:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787364826.395573:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787364826.396219:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688874112 00000100:00100000:3.0:1787364826.396227:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688874112 00000100:00100000:3.0:1787364826.396300:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 132 00000100:00100000:3.0:1787364826.396310:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688874112:12345-192.168.204.2@tcp:400: 00000100:00100000:3.0:1787364826.396352:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688874112:12345-192.168.204.2@tcp:400: Request processed in 44us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364826.396359:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 132 00000100:00100000:2.0:1787364826.396807:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688874240 00000100:00100000:2.0:1787364826.396814:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688874240 00000100:00100000:2.0:1787364826.397081:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:2.0:1787364826.397091:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688874240:12345-192.168.204.2@tcp:400: 00000100:00100000:2.0:1787364826.397157:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688874240:12345-192.168.204.2@tcp:400: Request processed in 68us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364826.397164:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00080000:3.0:1787364826.397405:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787364826.639751:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787364827.393516:0:8466:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff92d7a360 20000000:00000080:1.0:1787364827.393533:0:8466:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6c061f8800 uarg=0000000000000000 20000000:01000000:1.0:1787364827.393570:0:8466:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787364827.393573:0:8466:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787364827.393576:0:8466:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787364827.393582:0:8466:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787364827.393586:0:8466:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787364827.393600:0:8466:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787364827.393603:0:8466:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787364827.395757:0:8466:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787364827.395763:0:8466:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787364827.397380:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787364827.397776:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787364827.398125:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787364827.398166:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787364827.398181:0:8466:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787364827.398184:0:8466:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787364827.401742:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787364827.403240:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787364827.403296:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787364827.403336:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787364827.403350:0:8466:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787364827.403353:0:8466:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787364827.405197:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787364827.406239:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787364827.406524:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787364827.406566:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787364827.406582:0:8466:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787364827.406585:0:8466:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787364827.408503:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787364827.410451:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787364827.410510:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787364827.410566:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1787364827.410594:0:8466:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787364827.410617:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410636:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410644:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410650:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410656:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410662:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410668:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410674:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410683:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410688:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410696:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410741:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410756:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 9 pid: 5850 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.410770:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714062848:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364827.410900:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.410994:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 9 pid: 5849 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.411003:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714062976:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364827.411051:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.411060:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 18 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.411069:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063104:0@lo:104: 00000100:00100000:0.0:1787364827.411108:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787364827.411146:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.411154:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 18 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.411171:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063232:0@lo:104: 00000100:00100000:0.0:1787364827.411195:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787364827.411216:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.411224:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 18 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.411232:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063360:0@lo:104: 00010000:00010000:0.0:1787364827.411256:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.411263:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 18 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.411270:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063488:0@lo:104: 00010000:00010000:0.0:1787364827.411297:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.411304:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 18 pid: 5849 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.411311:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063616:0@lo:104: 00010000:00010000:0.0:1787364827.411333:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.411340:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 18 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.411358:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063744:0@lo:104: 00010000:00010000:0.0:1787364827.411385:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.411392:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 18 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.411399:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063872:0@lo:104: 00000100:00100000:0.0:1787364827.411416:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d401149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364827.412242:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787364827.412271:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364827.412289:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364827.412297:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364827.412304:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364827.412311:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364827.412320:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714063104 00000100:00100000:3.0:1787364827.412327:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714063104 00000100:00100000:3.0:1787364827.412365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714063232 00000100:00100000:3.0:1787364827.412368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714063232 00000100:00100000:3.0:1787364827.412378:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714063360 00000100:00100000:3.0:1787364827.412380:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714063360 00000100:00100000:3.0:1787364827.412387:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714063488 00000100:00100000:3.0:1787364827.412389:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714063488 00000100:00100000:3.0:1787364827.412398:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714063616 00000100:00100000:3.0:1787364827.412400:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714063616 00000100:00100000:3.0:1787364827.412408:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714063744 00000100:00100000:3.0:1787364827.412410:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714063744 00000100:00100000:3.0:1787364827.412417:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714063872 00000100:00100000:3.0:1787364827.412419:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714063872 00000100:00100000:3.0:1787364827.412446:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787364827.412454:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:8466:x1874187714063104:12345-0@lo:104: 00010000:00010000:3.0:1787364827.412469:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.412538:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787364827.412544:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+9:8466:x1874187714063104:12345-0@lo:104: Request processed in 91us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.412551:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787364827.412569:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787364827.412575:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+8:8466:x1874187714063232:12345-0@lo:104: 00010000:00010000:3.0:1787364827.412582:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.412622:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787364827.412627:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+8:8466:x1874187714063232:12345-0@lo:104: Request processed in 53us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.412632:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787364827.412683:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787364827.412689:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+7:8466:x1874187714063360:12345-0@lo:104: 00010000:00010000:3.0:1787364827.412697:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.412726:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787364827.412731:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+7:8466:x1874187714063360:12345-0@lo:104: Request processed in 43us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.412737:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787364827.412747:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787364827.412760:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+6:8466:x1874187714063488:12345-0@lo:104: 00010000:00010000:3.0:1787364827.412767:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.412816:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787364827.412821:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+6:8466:x1874187714063488:12345-0@lo:104: Request processed in 63us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.412826:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787364827.412854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787364827.412860:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:8466:x1874187714063616:12345-0@lo:104: 00010000:00010000:3.0:1787364827.412869:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.412895:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787364827.412899:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:8466:x1874187714063616:12345-0@lo:104: Request processed in 41us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.412905:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787364827.412915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787364827.412920:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:8466:x1874187714063744:12345-0@lo:104: 00010000:00010000:3.0:1787364827.412927:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.412950:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787364827.412955:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:8466:x1874187714063744:12345-0@lo:104: Request processed in 35us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.412960:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787364827.412971:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787364827.412996:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:8466:x1874187714063872:12345-0@lo:104: 00010000:00010000:3.0:1787364827.413004:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413034:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787364827.413038:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:8466:x1874187714063872:12345-0@lo:104: Request processed in 45us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.413043:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787364827.413062:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787364827.413069:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413076:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e34000 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364827.413080:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413089:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364827.413095:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364827.413101:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364827.413135:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413141:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364827.413158:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413176:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34000/0xcfc9272e5fc2ae1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ae25 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413192:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787364827.413195:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413200:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0a00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364827.413204:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413210:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364827.413215:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364827.413220:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364827.413235:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413240:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364827.413245:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413252:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2adf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2adfb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413260:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787364827.413274:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413280:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364827.413282:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413288:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364827.413294:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364827.413299:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364827.413312:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413318:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364827.413332:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413339:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d00030e00/0xcfc9272e5fc2add8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2addf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413348:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787364827.413351:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413357:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c9800 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364827.413359:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413376:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364827.413381:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364827.413386:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364827.413400:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413405:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364827.413411:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413417:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9800/0xcfc9272e5fc2adca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2add1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413426:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787364827.413429:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413435:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364827.413438:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413445:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364827.413451:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364827.413463:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364827.413476:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413481:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364827.413486:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413492:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d28335e00/0xcfc9272e5fc2adbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2adc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413503:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787364827.413506:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413512:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030a00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364827.413515:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413520:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364827.413526:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364827.413531:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364827.413543:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413548:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364827.413559:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413565:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d00030a00/0xcfc9272e5fc2ad92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad99 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413573:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787364827.413576:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413581:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c8a00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787364827.413583:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413589:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787364827.413595:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364827.413599:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787364827.413611:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413616:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787364827.413620:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413625:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2ad68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad6f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413638:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364827.413645:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364827.413647:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364827.413662:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714064256:0@lo:103: 00000100:00100000:3.0:1787364827.413699:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364827.413721:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714064768:0@lo:103: 00000100:00100000:3.0:1787364827.413742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364827.413761:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787364827.413767:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714064384:0@lo:103: 00000100:00100000:3.0:1787364827.413814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364827.413848:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714064256 00000100:00100000:3.0:1787364827.413855:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714064256 00010000:00010000:3.0:1787364827.413876:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 19 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364827.413893:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714064768 00000100:00100000:3.0:1787364827.413895:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714064768 00010000:00010000:3.0:1787364827.413906:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 20 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364827.413916:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714064384 00000100:00100000:3.0:1787364827.413918:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714064384 00010000:00010000:3.0:1787364827.413931:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 21 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364827.413941:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787364827.413947:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+21:3313:x1874187714064256:12345-0@lo:103: 00010000:00010000:3.0:1787364827.413958:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364827.413963:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 21 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.413995:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 21 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.414012:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364827.414040:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+21:3313:x1874187714064256:12345-0@lo:103: Request processed in 94us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.414047:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787364827.414061:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787364827.414067:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+20:3313:x1874187714064768:12345-0@lo:103: 00010000:00010000:3.0:1787364827.414074:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364827.414078:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 20 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.414086:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 20 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.414094:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364827.414113:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+20:3313:x1874187714064768:12345-0@lo:103: Request processed in 47us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.414118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787364827.414128:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787364827.414133:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714064384:12345-0@lo:103: 00010000:00010000:3.0:1787364827.414139:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364827.414143:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 19 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.414150:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 19 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.414166:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364827.414187:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714064384:12345-0@lo:103: Request processed in 53us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.414193:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787364827.414230:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714064384:0@lo:103: 00000100:00100000:3.0:1787364827.414238:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714064256:0@lo:103: 00000100:00100000:3.0:1787364827.414244:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714064768:0@lo:103: 00000100:00100000:0.0:1787364827.417734:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063104:0@lo:104: 00000100:00100000:0.0:1787364827.417750:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063232:0@lo:104: 00010000:00010000:0.0:1787364827.417761:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2addf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2add8 expref: 18 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.417778:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063360:0@lo:104: 00010000:00010000:0.0:1787364827.417843:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0e00/0xcfc9272e5fc2add1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2adca expref: 17 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.417853:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063488:0@lo:104: 00000100:00100000:0.0:1787364827.417881:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063616:0@lo:104: 00000100:00100000:0.0:1787364827.417890:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063744:0@lo:104: 00010000:00010000:0.0:1787364827.417899:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2ad6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad68 expref: 16 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364827.417910:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714063872:0@lo:104: 00010000:00010000:0.0:1787364827.417955:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364827.418011:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714064000:0@lo:103: 00000100:00100000:0.0:1787364827.418080:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364827.418127:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714064512:0@lo:103: 00000100:00100000:0.0:1787364827.418150:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364827.418173:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787364827.418179:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714064128:0@lo:103: 00000100:00100000:0.0:1787364827.418197:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364827.418211:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714064640:0@lo:103: 00000100:00100000:0.0:1787364827.418233:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364827.418320:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714064000 00000100:00100000:1.0:1787364827.418327:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714064000 00010000:00010000:1.0:1787364827.418358:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 16 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364827.418377:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714064512 00000100:00100000:1.0:1787364827.418379:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714064512 00010000:00010000:1.0:1787364827.418390:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 17 pid: 5849 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364827.418408:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714064128 00000100:00100000:1.0:1787364827.418411:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714064128 00010000:00010000:1.0:1787364827.418421:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 18 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364827.418430:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714064640 00000100:00100000:1.0:1787364827.418432:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714064640 00010000:00010000:1.0:1787364827.418440:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 19 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364827.418452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787364827.418459:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714064000:12345-0@lo:103: 00010000:00010000:1.0:1787364827.418472:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364827.418477:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 19 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418487:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 19 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418504:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2ae25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ae1e expref: 19 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418517:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364827.418564:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:3315:x1874187714064000:12345-0@lo:103: Request processed in 104us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364827.418571:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787364827.418587:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787364827.418593:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:3315:x1874187714064512:12345-0@lo:103: 00010000:00010000:1.0:1787364827.418609:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364827.418614:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 17 pid: 5849 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418622:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 17 pid: 5849 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418632:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2adc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2adbc expref: 17 pid: 5849 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418641:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364827.418663:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3315:x1874187714064512:12345-0@lo:103: Request processed in 70us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364827.418669:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787364827.418681:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787364827.418688:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:3315:x1874187714064128:12345-0@lo:103: 00010000:00010000:1.0:1787364827.418694:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364827.418698:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 15 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418706:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 15 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418715:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2adfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2adf4 expref: 15 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418725:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364827.418745:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:3315:x1874187714064128:12345-0@lo:103: Request processed in 59us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364827.418750:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787364827.418768:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787364827.418774:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:3315:x1874187714064640:12345-0@lo:103: 00010000:00010000:1.0:1787364827.418782:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364827.418808:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 13 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418816:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 13 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418827:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2ad99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad92 expref: 13 pid: 5850 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364827.418836:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364827.418860:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:3315:x1874187714064640:12345-0@lo:103: Request processed in 86us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364827.418866:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787364827.419737:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714064128:0@lo:103: 00000100:00100000:0.0:1787364827.419747:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714064640:0@lo:103: 00000100:00100000:0.0:1787364827.419755:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714064000:0@lo:103: 00000100:00100000:0.0:1787364827.419761:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714064512:0@lo:103: 00000100:00100000:1.0:1787364827.420041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364827.420072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364827.420130:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714062848:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364827.420139:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1874187714062976:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364827.420178:0:8466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364827.420229:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688874624 00000100:00100000:3.0:1787364827.420236:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688874624 00010000:00010000:3.0:1787364827.420263:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 10 pid: 5850 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364827.420295:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688874752 00000100:00100000:3.0:1787364827.420298:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688874752 00010000:00010000:3.0:1787364827.420309:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 11 pid: 5849 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364827.420322:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:3.0:1787364827.420329:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf99abb4-88a3-48fa-9491-b4225d983398+11:2367:x1874187688874624:12345-192.168.204.2@tcp:103: 00010000:00010000:3.0:1787364827.420342:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364827.420346:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 11 pid: 5850 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420355:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 11 pid: 5850 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420369:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2ae3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da1c expref: 11 pid: 5850 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420391:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364827.420781:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2367:x1874187688874624:12345-192.168.204.2@tcp:103: Request processed in 450us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.420810:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:3.0:1787364827.420840:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:3.0:1787364827.420849:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf99abb4-88a3-48fa-9491-b4225d983398+9:2367:x1874187688874752:12345-192.168.204.2@tcp:103: 00010000:00010000:3.0:1787364827.420857:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364827.420862:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 9 pid: 5849 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420872:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 9 pid: 5849 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420883:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e34800/0xcfc9272e5fc2ae33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da15 expref: 9 pid: 5849 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420895:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420903:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420918:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420925:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420932:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420944:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420951:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364827.420955:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420963:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420975:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.420996:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364827.421018:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf99abb4-88a3-48fa-9491-b4225d983398+8:2367:x1874187688874752:12345-192.168.204.2@tcp:103: Request processed in 171us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364827.421025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 20 00010000:00010000:0.0:1787364827.421101:0:8466:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.421111:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364827.421116:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e4800/0xcfc9272e5fc2ae72 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364827.659169:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364828.683457:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787364829.068619:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787364829.068628:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6c06f84800 from 39 10000000:01000000:0.0:1787364829.068633:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787364829.068685:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.068697:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.068707:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364829.068730:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714064896:0@lo:101: 00000100:00100000:0.0:1787364829.068830:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.068891:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d401149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.069007:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714064896 00000100:00100000:2.0:1787364829.069024:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714064896 00000100:00100000:2.0:1787364829.069082:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787364829.069091:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+12:5853:x1874187714064896:12345-0@lo:101: 00010000:00010000:2.0:1787364829.069105:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364829.069128:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e35800/0xcfc9272e5fc2ae80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ae79 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.069168:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e35800/0xcfc9272e5fc2ae80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae79 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.069178:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e35800/0xcfc9272e5fc2ae80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae79 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.069186:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35800, rc 0) 00000100:00100000:2.0:1787364829.069230:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714064896:12345-0@lo:101: Request processed in 140us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.069237:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787364829.069978:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714064896:0@lo:101: 00010000:00010000:1.0:1787364829.069995:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364829.070005:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364829.070083:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065024:0@lo:501: 00000100:00100000:1.0:1787364829.070286:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.070324:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787364829.070374:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714065024 00000100:00100000:0.0:1787364829.070380:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714065024 00000100:00100000:0.0:1787364829.070418:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787364829.070427:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714065024:12345-0@lo:501: 00000100:00100000:0.0:1787364829.070709:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714065024:12345-0@lo:501: Request processed in 283us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.070716:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787364829.071243:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065024:0@lo:501: 00000100:00100000:1.0:1787364829.071293:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065152:0@lo:503: 00000100:00100000:1.0:1787364829.071350:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.071381:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.071439:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714065152 00000100:00100000:3.0:1787364829.071444:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714065152 00000100:00100000:3.0:1787364829.071491:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787364829.071499:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714065152:12345-0@lo:503: 00000100:00100000:3.0:1787364829.071659:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714065152:12345-0@lo:503: Request processed in 161us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.071667:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787364829.071966:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065152:0@lo:503: 00000100:00100000:1.0:1787364829.072761:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8482:1874187714065280:0@lo:502: 00000100:00100000:1.0:1787364829.072855:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.072890:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.072961:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714065280 00000100:00100000:3.0:1787364829.072967:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714065280 00000100:00100000:3.0:1787364829.073002:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787364829.073030:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:8482:x1874187714065280:12345-0@lo:502: 00000100:00100000:3.0:1787364829.073643:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:8482:x1874187714065280:12345-0@lo:502: Request processed in 612us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.073652:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787364829.075741:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8482:1874187714065280:0@lo:502: 00000100:00100000:1.0:1787364829.075848:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8482:1874187714065408:0@lo:502: 00000100:00100000:1.0:1787364829.075910:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.075969:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787364829.076629:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714065408 00000100:00100000:0.0:1787364829.076638:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714065408 00000100:00100000:0.0:1787364829.076689:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787364829.076698:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:8482:x1874187714065408:12345-0@lo:502: 00000100:00100000:0.0:1787364829.076992:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:8482:x1874187714065408:12345-0@lo:502: Request processed in 295us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.077006:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787364829.078525:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8482:1874187714065408:0@lo:502: 00000040:00080000:1.0:1787364829.078561:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787364829.078893:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787364829.078912:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787364829.078923:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.078943:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364829.078959:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787364829.078961:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787364829.078964:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787364829.078996:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.079004:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.079110:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364829.079195:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065536:0@lo:101: 00000100:00100000:3.0:1787364829.079251:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364829.079297:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d05525d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787364829.080515:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714065536 00000100:00100000:0.0:1787364829.080525:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714065536 00000100:00100000:0.0:1787364829.080589:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787364829.080599:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+13:5853:x1874187714065536:12345-0@lo:101: 00010000:00010000:0.0:1787364829.080612:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364829.080628:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e5400/0xcfc9272e5fc2ae8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ae87 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.080652:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e5400/0xcfc9272e5fc2ae8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae87 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.080663:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e5400/0xcfc9272e5fc2ae8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae87 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.080671:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5400, rc 0) 00000100:00100000:0.0:1787364829.080734:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714065536:12345-0@lo:101: Request processed in 136us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.080741:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787364829.082002:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065536:0@lo:101: 00010000:00010000:3.0:1787364829.082029:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.082054:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364829.083379:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065664:0@lo:501: 00000100:00100000:3.0:1787364829.083447:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364829.083496:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d05525d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.084482:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714065664 00000100:00100000:2.0:1787364829.084492:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714065664 00000100:00100000:2.0:1787364829.084551:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787364829.084563:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714065664:12345-0@lo:501: 00000100:00100000:2.0:1787364829.084896:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714065664:12345-0@lo:501: Request processed in 335us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.084903:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787364829.085714:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065664:0@lo:501: 00000100:00100000:3.0:1787364829.085776:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065792:0@lo:503: 00000100:00100000:3.0:1787364829.085850:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364829.085878:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d05525d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787364829.087039:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714065792 00000100:00100000:0.0:1787364829.087048:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714065792 00000100:00100000:0.0:1787364829.087108:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787364829.087126:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714065792:12345-0@lo:503: 00000100:00100000:0.0:1787364829.087330:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714065792:12345-0@lo:503: Request processed in 214us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.087338:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787364829.087740:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714065792:0@lo:503: 00000100:00100000:3.0:1787364829.090248:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8483:1874187714065920:0@lo:502: 00000100:00100000:3.0:1787364829.090336:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364829.090382:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787364829.090496:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714065920 00000100:00100000:0.0:1787364829.090503:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714065920 00000100:00100000:0.0:1787364829.090557:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787364829.090566:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:8483:x1874187714065920:12345-0@lo:502: 00000100:00100000:0.0:1787364829.090768:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:8483:x1874187714065920:12345-0@lo:502: Request processed in 202us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.090775:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787364829.090944:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8483:1874187714065920:0@lo:502: 00000020:01000000:3.0:1787364829.090984:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787364829.090993:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364829.090995:0:8483:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787364829.091001:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787364829.091031:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8483:1874187714066048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787364829.091064:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364829.091094:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.091194:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714066048 00000100:00100000:2.0:1787364829.091199:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714066048 00000100:00100000:2.0:1787364829.091230:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787364829.091238:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:8483:x1874187714066048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364829.091360:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:8483:x1874187714066048:12345-0@lo:502:llog_process_th.0 Request processed in 123us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.091367:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787364829.091546:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8483:1874187714066048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787364829.091566:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787364829.091576:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364829.091577:0:8483:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787364829.091581:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787364829.091845:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787364829.091864:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787364829.091878:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.091889:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364829.091898:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787364829.091901:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d055cd000 from 39 10000000:01000000:2.0:1787364829.091903:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787364829.091937:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.091953:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.091963:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364829.091978:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.092018:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.092041:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12780 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.092053:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714066176 00000100:00100000:2.0:1787364829.092057:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714066176 00000100:00100000:2.0:1787364829.092081:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787364829.092088:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:5853:x1874187714066176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364829.092096:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364829.092108:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e34600/0xcfc9272e5fc2ae9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2ae95 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.092142:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e34600/0xcfc9272e5fc2ae9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae95 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.092158:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e34600/0xcfc9272e5fc2ae9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae95 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.092167:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e34600, rc 0) 00000100:00100000:2.0:1787364829.092198:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714066176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.092204:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787364829.092231:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364829.092242:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.092250:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364829.092288:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.092309:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.092321:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12780 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.092330:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714066304 00000100:00100000:2.0:1787364829.092333:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714066304 00000100:00100000:2.0:1787364829.092352:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787364829.092358:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714066304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.092569:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714066304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.092576:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787364829.092603:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.092634:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.092665:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.092679:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12780 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.092689:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714066432 00000100:00100000:2.0:1787364829.092692:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714066432 00000100:00100000:2.0:1787364829.092711:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787364829.092717:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714066432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.092872:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714066432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.092879:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787364829.092913:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364829.095507:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8484:1874187714066560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787364829.095588:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364829.095633:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.096280:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714066560 00000100:00100000:2.0:1787364829.096288:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714066560 00000100:00100000:2.0:1787364829.096381:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787364829.096391:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:8484:x1874187714066560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364829.096657:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:8484:x1874187714066560:12345-0@lo:502:llog_process_th.0 Request processed in 266us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.096665:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787364829.096758:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8484:1874187714066560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364829.096842:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8484:1874187714066688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364829.096880:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.108356:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40114e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.108567:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714066688 00000100:00100000:3.0:1787364829.108577:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714066688 00000100:00100000:1.0:1787364829.108679:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787364829.108692:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:8484:x1874187714066688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364829.109285:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:8484:x1874187714066688:12345-0@lo:502:llog_process_th.0 Request processed in 595us (12402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364829.109294:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787364829.111828:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8484:1874187714066688:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787364829.111883:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787364829.112204:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787364829.112229:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787364829.112239:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.112250:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364829.112278:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787364829.112281:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787364829.112284:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787364829.112317:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.112324:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.112333:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364829.112355:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.112412:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.112458:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.112643:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714066816 00000100:00100000:3.0:1787364829.112650:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714066816 00000100:00100000:3.0:1787364829.112690:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787364829.112699:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:5853:x1874187714066816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787364829.112712:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364829.112726:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2aeaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2aea3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.113185:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2aeaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aea3 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.113199:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2aeaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aea3 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.113209:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28335e00, rc 0) 00000100:00100000:3.0:1787364829.113304:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714066816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 605us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.113311:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787364829.115747:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364829.115777:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.115849:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364829.117003:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.117080:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.117229:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364829.117310:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714066944 00000100:00100000:1.0:1787364829.117318:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714066944 00000100:00100000:1.0:1787364829.117360:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787364829.117374:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714066944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364829.117682:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714066944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364829.120247:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787364829.120390:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714066944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364829.120450:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714067072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364829.120526:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364829.120567:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787364829.121031:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714067072 00000100:00100000:1.0:1787364829.121037:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714067072 00000100:00100000:1.0:1787364829.121076:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787364829.121086:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714067072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787364829.121294:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714067072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364829.121302:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787364829.121742:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714067072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364829.122479:0:8485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8485:1874187714067200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787364829.122548:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364829.122585:0:8485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787364829.122715:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714067200 00000100:00100000:1.0:1787364829.122721:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714067200 00000100:00100000:1.0:1787364829.122768:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787364829.122777:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:8485:x1874187714067200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364829.123576:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:8485:x1874187714067200:12345-0@lo:502:llog_process_th.0 Request processed in 797us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.123585:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787364829.123675:0:8485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8485:1874187714067200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787364829.123718:0:8485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787364829.123729:0:8485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364829.123731:0:8485:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787364829.123737:0:8485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787364829.123765:0:8485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8485:1874187714067328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364829.124075:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.124110:0:8485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.124197:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714067328 00000100:00100000:2.0:1787364829.124202:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714067328 00000100:00100000:2.0:1787364829.124243:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787364829.124250:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:8485:x1874187714067328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364829.124393:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:8485:x1874187714067328:12345-0@lo:502:llog_process_th.0 Request processed in 143us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.124400:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787364829.124501:0:8485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8485:1874187714067328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787364829.124521:0:8485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787364829.124526:0:8485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364829.124527:0:8485:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787364829.124531:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787364829.131893:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787364829.132181:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787364829.132195:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.132208:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364829.132220:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787364829.132222:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d20269000 from 39 10000000:01000000:0.0:1787364829.132225:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787364829.132264:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.132288:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.132300:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364829.132323:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714067456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787364829.132385:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.135381:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40114900 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.138838:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714067456 00000100:00100000:3.0:1787364829.138854:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714067456 00000100:00100000:3.0:1787364829.138915:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787364829.138926:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714067456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787364829.138963:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364829.138983:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2aeb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2aeb1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.139011:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2aeb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aeb1 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.139023:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2aeb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aeb1 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.139034:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334e00, rc 0) 00000100:00100000:2.0:1787364829.139356:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714067456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364829.139375:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.139385:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364829.139451:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714067584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.139487:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.139517:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06347540 going to sleep for 11 seconds 00000100:00100000:0.0:1787364829.139598:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714067584 00000100:00100000:0.0:1787364829.139604:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714067584 00000100:00100000:0.0:1787364829.139625:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787364829.139633:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714067584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364829.139921:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714067584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.139939:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787364829.140235:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714067584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.140266:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714067712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.140309:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.140329:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06347540 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.140391:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714067456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1465us (8003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.140398:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787364829.140418:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714067712 00000100:00100000:3.0:1787364829.140422:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714067712 00000100:00100000:3.0:1787364829.140441:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787364829.140447:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714067712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364829.140629:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714067712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.140636:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787364829.140720:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714067712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.143416:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8486:1874187714067840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364829.143495:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.143539:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06347cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.143593:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714067840 00000100:00100000:3.0:1787364829.143600:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714067840 00000100:00100000:3.0:1787364829.143649:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787364829.143658:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:8486:x1874187714067840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787364829.143917:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:8486:x1874187714067840:12345-0@lo:502:llog_process_th.0 Request processed in 260us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.144088:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8486:1874187714067840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364829.144156:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8486:1874187714067968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364829.144191:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.144205:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06347cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364829.144309:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714067968 00000100:00100000:0.0:1787364829.144314:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714067968 00000100:00100000:3.0:1787364829.144343:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787364829.149348:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787364829.149369:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:8486:x1874187714067968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364829.149666:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:8486:x1874187714067968:12345-0@lo:502:llog_process_th.0 Request processed in 305us (5473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.149674:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787364829.151309:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8486:1874187714067968:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787364829.151354:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787364829.151530:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787364829.151562:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787364829.151574:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364829.151585:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364829.151595:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787364829.151598:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787364829.151601:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787364829.151634:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364829.151642:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364829.151651:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364829.151673:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787364829.151725:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.151773:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.152881:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714068096 00000100:00100000:2.0:1787364829.152891:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714068096 00000100:00100000:2.0:1787364829.153008:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787364829.153021:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714068096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364829.153037:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364829.153052:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e34200/0xcfc9272e5fc2aec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2aebf expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.153077:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e34200/0xcfc9272e5fc2aec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aebf expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.153088:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e34200/0xcfc9272e5fc2aec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aebf expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.153097:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e34200, rc 0) 00000100:00100000:2.0:1787364829.153316:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714068096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 298us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.153323:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787364829.153400:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364829.153416:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364829.153425:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364829.153487:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364829.153530:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.153567:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.153615:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714068224 00000100:00100000:3.0:1787364829.153618:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714068224 00000100:00100000:3.0:1787364829.153649:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787364829.153656:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714068224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364829.154226:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714068224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 569us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.154234:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787364829.154393:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364829.154426:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787364829.154468:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.154488:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787364829.154955:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714068352 00000100:00100000:2.0:1787364829.154961:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714068352 00000100:00100000:2.0:1787364829.154989:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787364829.154996:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714068352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.155899:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714068352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 900us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.155908:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787364829.156733:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787364829.157244:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8487:1874187714068480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364829.157298:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.157337:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787364829.157388:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714068480 00000100:00100000:0.0:1787364829.157394:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714068480 00000100:00100000:0.0:1787364829.157434:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787364829.157450:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8487:x1874187714068480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364829.157660:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8487:x1874187714068480:12345-0@lo:502:llog_process_th.0 Request processed in 211us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.157668:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787364829.157901:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8487:1874187714068480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787364829.158036:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787364829.158046:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364829.158049:0:8487:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787364829.158056:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787364829.158078:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8487:1874187714068608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364829.158114:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364829.158543:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.171089:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714068608 00000100:00100000:3.0:1787364829.171110:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714068608 00000100:00100000:2.0:1787364829.171326:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787364829.171338:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8487:x1874187714068608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364829.171668:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8487:x1874187714068608:12345-0@lo:502:llog_process_th.0 Request processed in 331us (13552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.171676:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787364829.172651:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8487:1874187714068608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787364829.172689:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787364829.172697:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364829.172713:0:8487:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787364829.172718:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787364829.173228:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787364829.173245:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787364829.173256:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.173266:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364829.173276:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787364829.173279:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d04f519b8 from 1 10000000:01000000:2.0:1787364829.173282:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787364829.173313:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.173321:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364829.173331:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364829.173351:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787364829.173413:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.173457:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.174324:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714068736 00000100:00100000:3.0:1787364829.174332:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714068736 00000100:00100000:3.0:1787364829.174381:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787364829.174399:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714068736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787364829.174413:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364829.174425:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28334200/0xcfc9272e5fc2aed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2aecd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.174447:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28334200/0xcfc9272e5fc2aed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aecd expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.174458:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28334200/0xcfc9272e5fc2aed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aecd expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.174466:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334200, rc 0) 00000100:00100000:3.0:1787364829.174525:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714068736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.174531:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787364829.175974:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787364829.175994:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aed4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.176005:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aed4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364829.176086:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364829.176904:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.176970:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d401149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364829.177088:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714068864 00000100:00100000:3.0:1787364829.177096:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714068864 00000100:00100000:3.0:1787364829.177160:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787364829.177170:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714068864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364829.177434:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714068864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (530us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787364829.177442:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787364829.177975:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714068864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787364829.178007:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787364829.178016:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aed4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.178026:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aed4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364829.199812:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714069376:0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.199907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.199970:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787364829.199977:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714068992:0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200018:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.200034:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714069504:0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200073:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.200102:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714069248:0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200136:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.200157:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787364829.200162:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714069120:0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200195:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364829.200231:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714069504 00000100:00100000:0.0:1787364829.200238:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714069504 00000100:00100000:0.0:1787364829.200306:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714069248 00000100:00100000:0.0:1787364829.200310:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714069248 00000100:00100000:0.0:1787364829.200331:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787364829.200339:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714069504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200387:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714069504:12345-0@lo:400:kworker.0 Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.200393:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787364829.200410:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787364829.200417:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714069248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200448:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714069248:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.200454:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787364829.200474:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714069376 00000100:00100000:0.0:1787364829.200477:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714069376 00000100:00100000:0.0:1787364829.200497:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714068992 00000100:00100000:0.0:1787364829.200499:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714068992 00000100:00100000:0.0:1787364829.200507:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714069120 00000100:00100000:0.0:1787364829.200516:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714069120 00000100:00100000:0.0:1787364829.200533:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787364829.200538:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714069376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200566:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714069376:12345-0@lo:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.200572:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787364829.200581:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787364829.200586:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714068992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200608:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714068992:12345-0@lo:400:kworker.0 Request processed in 22us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.200614:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787364829.200623:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787364829.200628:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714069120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200651:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714069120:12345-0@lo:400:kworker.0 Request processed in 23us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.200657:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787364829.200671:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787364829.200675:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787364829.200677:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787364829.200704:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714069120:0@lo:400:kworker.0 00010000:00080000:0.0:1787364829.200716:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd2300 x1874187714069248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364829.200725:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714069248:0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200752:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714068992:0@lo:400:kworker.0 00010000:00080000:0.0:1787364829.200762:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd2a00 x1874187714069504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364829.200778:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714069504:0@lo:400:kworker.0 00000100:00100000:0.0:1787364829.200813:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714069376:0@lo:400:kworker.0 00010000:00010000:1.0:1787364829.707712:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364829.707769:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787364829.707831:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714069632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364829.707900:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364829.708127:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714069632 00000100:00100000:2.0:1787364829.708133:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714069632 00000100:00100000:2.0:1787364829.708175:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787364829.708184:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714069632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364829.708215:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364829.708254:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714069632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364829.708261:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787364829.708902:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787364829.708924:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714069760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364829.708972:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787364829.709369:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fdd8000 x1874187714069632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364829.709391:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714069632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364829.710024:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714069760 00000100:00100000:1.0:1787364829.710033:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714069760 00000100:00100000:1.0:1787364829.710095:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787364829.710111:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714069760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364829.710143:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364829.710215:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714069760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364829.710235:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787364829.712538:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd0e00 x1874187714069760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364829.712564:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714069760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364829.723931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364829.724222:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688874880 00000100:00100000:3.0:1787364829.724233:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688874880 00000100:00100000:3.0:1787364829.724297:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 165 00000100:00100000:3.0:1787364829.724472:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+8:5608:x1874187688874880:12345-192.168.204.2@tcp:101: 00010000:00010000:3.0:1787364829.724491:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364829.724510:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2aedb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da7e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.724538:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2aedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da7e expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.724549:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2aedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da7e expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364829.724558:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334600, rc 0) 00000100:00100000:3.0:1787364829.724616:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+9:5608:x1874187688874880:12345-192.168.204.2@tcp:101: Request processed in 296us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.724623:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 165 00000100:00100000:3.0:1787364829.727546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364829.727691:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688875008 00000100:00100000:0.0:1787364829.727700:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688875008 00000100:00100000:0.0:1787364829.727752:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 166 00000100:00100000:0.0:1787364829.727763:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+9:5608:x1874187688875008:12345-192.168.204.2@tcp:501: 00000100:00100000:0.0:1787364829.728333:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+9:5608:x1874187688875008:12345-192.168.204.2@tcp:501: Request processed in 345us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.728342:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 166 00000100:00100000:0.0:1787364829.739110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364829.739331:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688875136 00000100:00100000:3.0:1787364829.739343:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688875136 00000100:00100000:3.0:1787364829.739407:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 167 00000100:00100000:3.0:1787364829.739419:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+9:5608:x1874187688875136:12345-192.168.204.2@tcp:503: 00000100:00100000:3.0:1787364829.739852:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+9:5608:x1874187688875136:12345-192.168.204.2@tcp:503: Request processed in 434us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.739862:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 167 00000100:00100000:1.0:1787364829.750253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364829.756947:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688875264 00000100:00100000:0.0:1787364829.756968:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688875264 00000100:00100000:0.0:1787364829.757058:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 168 00000100:00100000:0.0:1787364829.757089:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+9:6081:x1874187688875264:12345-192.168.204.2@tcp:502: 00000100:00100000:0.0:1787364829.757910:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+9:6081:x1874187688875264:12345-192.168.204.2@tcp:502: Request processed in 818us (7665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.758057:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 168 00000100:00100000:1.0:1787364829.764265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364829.764415:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688875392 00000100:00100000:3.0:1787364829.764428:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688875392 00000100:00100000:3.0:1787364829.764499:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 169 00000100:00100000:3.0:1787364829.764510:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+9:6081:x1874187688875392:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787364829.765134:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+9:6081:x1874187688875392:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 622us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364829.765144:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 169 00000100:00100000:1.0:1787364829.770577:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364829.770681:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688875520 00000100:00100000:0.0:1787364829.770694:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688875520 00000100:00100000:0.0:1787364829.770765:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 170 00000100:00100000:0.0:1787364829.770776:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+9:5608:x1874187688875520:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787364829.770852:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364829.770874:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2aee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da85 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.770912:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2aee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da85 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.770929:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2aee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da85 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364829.770949:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4400, rc 0) 00000100:00100000:0.0:1787364829.771008:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:5608:x1874187688875520:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 Request processed in 235us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364829.771016:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 170 00000100:00100000:1.0:1787364829.774964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364829.775101:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688875648 00000100:00100000:3.0:1787364829.775114:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688875648 00000100:00100000:3.0:1787364829.775241:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 171 00000100:00100000:3.0:1787364829.775254:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:5608:x1874187688875648:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364829.775631:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:5608:x1874187688875648:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 Request processed in 379us (680us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787364829.775641:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 171 00010000:00010000:0.0:1787364830.730959:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787364830.904887:0:8525:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2ad38070 20000000:00000080:0.0:1787364830.904923:0:8525:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6c061f6c00 uarg=0000000000000000 20000000:01000000:0.0:1787364830.905014:0:8525:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787364830.905020:0:8525:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787364830.905030:0:8525:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787364830.909118:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787364830.909179:0:8525:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787364830.915621:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787364830.915691:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787364830.915747:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787364830.915764:0:8525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787364830.915827:0:8525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.915847:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d00030000/0xcfc9272e5fc2ac5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.915854:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.915861:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.915871:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.915879:0:8525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.917035:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.917055:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 9 pid: 5850 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.917070:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1874187714069888:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364830.917223:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.917232:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 18 pid: 5850 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.917241:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1874187714070016:0@lo:104: 00000100:00100000:0.0:1787364830.917280:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787364830.917317:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.917326:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 18 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.917335:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1874187714070144:0@lo:104: 00000100:00100000:0.0:1787364830.917360:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787364830.917383:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d00030000/0xcfc9272e5fc2ac5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.917392:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d00030000/0xcfc9272e5fc2ac5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 18 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.917400:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1874187714070272:0@lo:104: 00000100:00100000:0.0:1787364830.917419:0:8525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364830.920971:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787364830.921021:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364830.921048:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714070016 00000100:00100000:2.0:1787364830.921057:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714070016 00000100:00100000:2.0:1787364830.921096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714070144 00000100:00100000:2.0:1787364830.921100:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714070144 00000100:00100000:2.0:1787364830.921111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714070272 00000100:00100000:2.0:1787364830.921113:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714070272 00000100:00100000:2.0:1787364830.921125:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787364830.921133:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:8525:x1874187714070016:12345-0@lo:104: 00010000:00010000:2.0:1787364830.921152:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364830.921236:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787364830.921242:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+5:8525:x1874187714070016:12345-0@lo:104: Request processed in 110us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364830.921249:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787364830.921266:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787364830.921272:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0621f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:8525:x1874187714070144:12345-0@lo:104: 00010000:00010000:2.0:1787364830.921293:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364830.921328:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787364830.921334:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0621f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:8525:x1874187714070144:12345-0@lo:104: Request processed in 63us (3974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364830.921340:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787364830.921370:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787364830.921376:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:8525:x1874187714070272:12345-0@lo:104: 00010000:00010000:2.0:1787364830.921383:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364830.921409:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787364830.921414:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:8525:x1874187714070272:12345-0@lo:104: Request processed in 39us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364830.921419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787364830.921637:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787364830.921645:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921653:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c8000 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364830.921657:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921672:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364830.921680:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364830.921686:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787364830.921751:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921758:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364830.921778:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921802:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2ad84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ad8b expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921818:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787364830.921821:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921827:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c9600 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364830.921830:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921836:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364830.921842:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364830.921854:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787364830.921869:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921875:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364830.921881:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921887:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2acb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2acc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.921906:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364830.922059:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922065:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364830.922068:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922075:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364830.922080:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364830.922085:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787364830.922099:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922104:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364830.922128:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922133:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2ac57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2ac5e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922147:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364830.922148:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364830.922150:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364830.922248:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714070400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364830.922289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364830.922328:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364830.922334:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714070528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364830.922356:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364830.922383:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714070656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364830.922403:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364830.922437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714070400 00000100:00100000:0.0:1787364830.922441:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714070400 00010000:00010000:0.0:1787364830.922466:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 19 pid: 5850 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.922483:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714070528 00000100:00100000:0.0:1787364830.922486:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714070528 00010000:00010000:0.0:1787364830.922497:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 20 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.922508:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714070656 00000100:00100000:0.0:1787364830.922510:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714070656 00010000:00010000:0.0:1787364830.922520:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d00030000/0xcfc9272e5fc2ac5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 21 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.922542:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787364830.922548:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+21:3313:x1874187714070400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787364830.922557:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364830.922562:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 21 pid: 5850 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922570:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 21 pid: 5850 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922585:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364830.922614:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+21:3313:x1874187714070400:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364830.922621:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787364830.922637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787364830.922642:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+20:3313:x1874187714070528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787364830.922650:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364830.922653:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 20 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922661:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 20 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.922671:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364830.922690:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+20:3313:x1874187714070528:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364830.922696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787364830.922819:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364830.924090:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787364830.924110:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714070656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787364830.924124:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364830.924130:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d00030000/0xcfc9272e5fc2ac5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 19 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.924142:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d00030000/0xcfc9272e5fc2ac5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 19 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364830.924157:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364830.924207:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714070656:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364830.924214:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787364830.924270:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00031c00/0xcfc9272e5fc2ad8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ad84 expref: 18 pid: 5850 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.924283:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1874187714070016:0@lo:104: 00010000:00010000:0.0:1787364830.924293:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0400/0xcfc9272e5fc2acc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2acb9 expref: 17 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.924300:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1874187714070144:0@lo:104: 00010000:00010000:0.0:1787364830.924308:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00030000/0xcfc9272e5fc2ac5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2ac57 expref: 16 pid: 5849 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364830.924315:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1874187714070272:0@lo:104: 00000100:00100000:0.0:1787364830.924335:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714070528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364830.924342:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714070400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787364830.924511:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714070656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364830.927053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364830.927201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688875776 00000100:00100000:3.0:1787364830.927209:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688875776 00010000:00010000:3.0:1787364830.927245:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 10 pid: 5850 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364830.927294:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:3.0:1787364830.927304:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688875776:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364830.927318:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364830.927325:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 10 pid: 5850 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927337:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 10 pid: 5850 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927358:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927377:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927394:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927401:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927407:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927414:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927419:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364830.927423:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927430:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927438:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364830.927449:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364830.927500:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688875776:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 197us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364830.927508:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 24 00010000:00010000:2.0:1787364830.927664:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00030600/0xcfc9272e5fc2ae48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da4d expref: 9 pid: 5850 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364830.927679:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1874187714069888:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364830.927717:0:8525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364830.927726:0:8525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364830.927732:0:8525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364830.927749:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e4600/0xcfc9272e5fc2aee9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364831.540118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364831.540176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364831.540210:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364831.540239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364831.540267:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688876160 00000100:00100000:1.0:1787364831.540276:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688876160 00000100:00100000:1.0:1787364831.540333:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688876288 00000100:00100000:1.0:1787364831.540336:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688876288 00000100:00100000:1.0:1787364831.540365:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:1.0:1787364831.540376:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688876160:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364831.540448:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688876160:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364831.540456:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:1.0:1787364831.540475:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:1.0:1787364831.540482:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688876288:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364831.540507:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688876288:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364831.540514:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00080000:1.0:1787364831.540547:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364831.540551:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787364831.540865:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688876032 00000100:00100000:2.0:1787364831.540879:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688876032 00000100:00100000:2.0:1787364831.540934:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:2.0:1787364831.540941:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688876032:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364831.540980:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688876032:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 40us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364831.540986:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:3.0:1787364831.541879:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688875904 00000100:00100000:3.0:1787364831.542070:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688875904 00000100:00100000:3.0:1787364831.542185:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 172 00000100:00100000:3.0:1787364831.542194:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+9:2366:x1874187688875904:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364831.542243:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+9:2366:x1874187688875904:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 50us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364831.542527:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 172 00000100:00080000:1.0:1787364831.543132:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787364831.755531:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364831.775722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364831.775823:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688876416 00000100:00100000:3.0:1787364831.775833:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688876416 00000100:00100000:3.0:1787364831.775882:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 173 00000100:00100000:3.0:1787364831.775891:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+9:5608:x1874187688876416:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787364831.775919:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364831.775936:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da8c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364831.775964:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364831.775975:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364831.775985:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28335c00, rc 0) 00000100:00100000:3.0:1787364831.776042:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:5608:x1874187688876416:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 Request processed in 151us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364831.776049:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 173 00000100:00100000:1.0:1787364831.784731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364831.785992:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688876544 00000100:00100000:3.0:1787364831.786005:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688876544 00000100:00100000:3.0:1787364831.786073:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 174 00000100:00100000:3.0:1787364831.786082:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:5608:x1874187688876544:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364831.786737:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:5608:x1874187688876544:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 Request processed in 653us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364831.786747:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 174 00000100:00100000:1.0:1787364831.807695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364831.807847:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688876672 00000100:00100000:0.0:1787364831.807858:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688876672 00000100:00100000:0.0:1787364831.807921:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 175 00000100:00100000:0.0:1787364831.807931:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:5608:x1874187688876672:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364831.808138:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:5608:x1874187688876672:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 Request processed in 209us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364831.808146:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 175 00000100:00100000:1.0:1787364831.815122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364831.819152:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688876800 00000100:00100000:3.0:1787364831.820117:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688876800 00000100:00100000:2.0:1787364831.820453:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 176 00000100:00100000:2.0:1787364831.820463:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:6138:x1874187688876800:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787364831.820708:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:6138:x1874187688876800:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 246us (5596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364831.820717:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 176 00000100:00100000:1.0:1787364831.830429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364831.837518:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688876928 00000100:00100000:0.0:1787364831.837532:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688876928 00000100:00100000:0.0:1787364831.837599:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 177 00000100:00100000:0.0:1787364831.837609:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:6138:x1874187688876928:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787364831.838956:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:6138:x1874187688876928:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 1341us (8530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364831.838968:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 177 10000000:01000000:0.0:1787364832.656055:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787364832.656064:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6c06f84800 from 4 10000000:01000000:0.0:1787364832.656069:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787364832.656122:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364832.656134:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364832.656146:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364832.656172:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714070784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787364832.656277:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364832.656348:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364832.656630:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714070784 00000100:00100000:2.0:1787364832.656638:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714070784 00000100:00100000:2.0:1787364832.656692:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787364832.656701:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714070784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364832.656714:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364832.656727:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2aef7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364832.656749:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364832.656771:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364832.656779:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35200, rc 0) 00000100:00100000:2.0:1787364832.656851:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714070784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364832.656870:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787364832.656923:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714070784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364832.656938:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364832.656946:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364832.657001:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714070912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364832.657027:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364832.657040:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787364832.657171:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714070912 00000100:00100000:0.0:1787364832.657175:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714070912 00000100:00100000:0.0:1787364832.657198:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787364832.657204:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714070912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364832.657457:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714070912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364832.657464:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787364832.657499:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714070912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364832.657525:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714071040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364832.657561:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364832.657581:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787364832.657591:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714071040 00000100:00100000:0.0:1787364832.657593:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714071040 00000100:00100000:0.0:1787364832.657612:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787364832.657617:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714071040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364832.657743:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714071040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364832.657749:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787364832.657809:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714071040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364832.679457:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8588:1874187714071168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364832.679542:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364832.679594:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787364832.679709:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714071168 00000100:00100000:0.0:1787364832.679717:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714071168 00000100:00100000:0.0:1787364832.679770:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787364832.679780:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:8588:x1874187714071168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364832.680034:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:8588:x1874187714071168:12345-0@lo:502:llog_process_th.0 Request processed in 255us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364832.680047:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787364832.680199:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8588:1874187714071168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787364832.680237:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787364832.680246:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787364832.680249:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787364832.680256:0:8588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6c06f84800 00000020:00000080:2.0:1787364832.680258:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787364832.680345:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8588:1874187714071296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364832.680381:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364832.680406:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714071296 00000100:00100000:2.0:1787364832.680410:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714071296 00000100:00100000:2.0:1787364832.680432:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787364832.680439:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:8588:x1874187714071296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364832.680559:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:8588:x1874187714071296:12345-0@lo:502:llog_process_th.0 Request processed in 120us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364832.680565:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787364832.680598:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364832.680611:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8588:1874187714071296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787364832.680628:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787364832.680632:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787364832.680633:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787364832.680637:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787364832.688031:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787364832.688062:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787364832.688074:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.688087:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364832.688098:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787364832.688101:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d055cd000 from 4 10000000:01000000:1.0:1787364832.688104:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787364832.688142:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.688150:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.688161:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364832.688187:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714071424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787364832.688274:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364832.688328:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c55480 going to sleep for 11 seconds 00000100:00100000:1.0:1787364832.688349:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714071424 00000100:00100000:1.0:1787364832.688356:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714071424 00000100:00100000:1.0:1787364832.688398:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787364832.688407:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714071424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364832.688420:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364832.688433:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2af05 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.688456:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.688465:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.688473:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1400, rc 0) 00000100:00100000:1.0:1787364832.688513:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714071424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364832.688519:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787364832.688565:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714071424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364832.688579:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.688587:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364832.688633:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714071552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364832.688659:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364832.688682:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c55480 going to sleep for 11 seconds 00000100:00100000:1.0:1787364832.688694:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714071552 00000100:00100000:1.0:1787364832.688697:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714071552 00000100:00100000:1.0:1787364832.688719:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787364832.688725:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714071552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364832.697753:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714071552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 9019us (9083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364832.697768:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787364832.697926:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714071552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364832.697983:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714071680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364832.698029:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364832.698068:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26180 going to sleep for 11 seconds 00000100:00100000:1.0:1787364832.698174:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714071680 00000100:00100000:1.0:1787364832.698181:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714071680 00000100:00100000:1.0:1787364832.698230:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787364832.698239:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714071680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787364832.698391:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714071680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364832.698398:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787364832.698439:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714071680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787364832.698616:0:8590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8590:1874187714071808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364832.698654:0:8590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364832.698676:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714071808 00000100:00100000:1.0:1787364832.698680:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714071808 00000100:00100000:1.0:1787364832.698703:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787364832.698709:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8590:x1874187714071808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364832.698845:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8590:x1874187714071808:12345-0@lo:502:llog_process_th.0 Request processed in 136us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364832.698852:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787364832.698969:0:8590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364832.698989:0:8590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8590:1874187714071808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787364832.699008:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787364832.699017:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364832.699019:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787364832.699025:0:8590:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d055cd000 00000020:00000080:1.0:1787364832.699027:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787364832.699102:0:8590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8590:1874187714071936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364832.699134:0:8590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364832.699153:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714071936 00000100:00100000:1.0:1787364832.699156:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714071936 00000100:00100000:1.0:1787364832.699177:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787364832.699183:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8590:x1874187714071936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364832.699285:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:8590:x1874187714071936:12345-0@lo:502:llog_process_th.0 Request processed in 102us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364832.699292:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787364832.699323:0:8590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364832.699334:0:8590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8590:1874187714071936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787364832.699350:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787364832.699355:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364832.699356:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787364832.699359:0:8590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787364832.699402:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787364832.699419:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787364832.699428:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.701967:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364832.701995:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787364832.701998:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d20269000 from 4 10000000:01000000:1.0:1787364832.702001:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787364832.702036:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.702044:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.702054:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364832.702078:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714072064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787364832.702139:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364832.702182:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364832.702204:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714072064 00000100:00100000:1.0:1787364832.702209:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714072064 00000100:00100000:1.0:1787364832.702248:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787364832.702256:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714072064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364832.702268:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364832.702281:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2af13 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.702303:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.702314:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.702335:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1200, rc 0) 00000100:00100000:1.0:1787364832.702375:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714072064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364832.702382:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787364832.702426:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714072064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364832.702439:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.702448:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364832.702497:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714072192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364832.702520:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364832.702533:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18c559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364832.706991:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714072192 00000100:00100000:3.0:1787364832.707004:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714072192 00000100:00100000:3.0:1787364832.707056:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787364832.707065:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714072192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364832.707363:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714072192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (4841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364832.707371:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787364832.707427:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714072192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364832.707485:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714072320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364832.707534:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364832.707568:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787364832.707583:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714072320 00000100:00100000:3.0:1787364832.707587:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714072320 00000100:00100000:3.0:1787364832.707614:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787364832.707622:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714072320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364832.707834:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714072320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364832.707843:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787364832.707971:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714072320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364832.708142:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8592:1874187714072448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787364832.708180:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364832.708203:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714072448 00000100:00100000:3.0:1787364832.708207:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714072448 00000100:00100000:3.0:1787364832.708233:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787364832.708240:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:8592:x1874187714072448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787364832.708374:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:8592:x1874187714072448:12345-0@lo:502:llog_process_th.0 Request processed in 134us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364832.708380:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787364832.708412:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26240 going to sleep for 11 seconds 00000100:00100000:3.0:1787364832.708425:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8592:1874187714072448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787364832.708448:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787364832.708458:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787364832.708461:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787364832.708468:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d20269000 00000020:00000080:3.0:1787364832.708470:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787364832.708781:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8592:1874187714072576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787364832.708839:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364832.713033:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49000 going to sleep for 11 seconds 00000100:00100000:3.0:1787364832.713147:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714072576 00000100:00100000:3.0:1787364832.713156:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714072576 00000100:00100000:3.0:1787364832.713216:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787364832.713226:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:8592:x1874187714072576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787364832.713481:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:8592:x1874187714072576:12345-0@lo:502:llog_process_th.0 Request processed in 256us (4642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364832.713489:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787364832.720354:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:8592:1874187714072576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787364832.720404:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787364832.720413:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364832.720416:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787364832.720422:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787364832.720767:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787364832.720821:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787364832.720833:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364832.720844:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364832.779122:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364833.804257:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364834.315687:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714072704:0@lo:400:kworker.0 00000100:00100000:0.0:1787364834.315759:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364834.315917:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714072704 00000100:00100000:1.0:1787364834.315926:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714072704 00000100:00100000:1.0:1787364834.315985:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787364834.315995:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714072704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364834.316253:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714072832:0@lo:400:kworker.0 00000100:00100000:2.0:1787364834.316286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364834.316359:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364834.316365:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714072960:0@lo:400:kworker.0 00000100:00100000:2.0:1787364834.316390:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364834.316415:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714072832 00000100:00100000:2.0:1787364834.316419:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714072832 00000100:00100000:2.0:1787364834.316448:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714072960 00000100:00100000:2.0:1787364834.316450:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714072960 00000100:00100000:2.0:1787364834.316473:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787364834.316480:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714072832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364834.316535:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714072832:12345-0@lo:400:kworker.0 Request processed in 55us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364834.316541:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787364834.316557:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787364834.316562:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714072960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364834.316586:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714072960:12345-0@lo:400:kworker.0 Request processed in 25us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364834.316592:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787364834.316613:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364834.316642:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714072960:0@lo:400:kworker.0 00000100:00100000:2.0:1787364834.316653:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714072832:0@lo:400:kworker.0 00000100:00100000:1.0:1787364834.316747:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714072704:12345-0@lo:400:kworker.0 Request processed in 753us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364834.316754:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787364834.316914:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714073088:0@lo:400:kworker.0 00000100:00100000:1.0:1787364834.316946:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364834.317076:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714072704:0@lo:400:kworker.0 00000100:00100000:0.0:1787364834.317091:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714073216:0@lo:400:kworker.0 00000100:00100000:0.0:1787364834.317115:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364834.317158:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714073088 00000100:00100000:0.0:1787364834.317162:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714073088 00000100:00100000:0.0:1787364834.317198:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787364834.317204:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714073088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364834.317265:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714073216 00000100:00100000:2.0:1787364834.317269:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714073216 00000100:00100000:2.0:1787364834.317293:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787364834.317299:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714073216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364834.317333:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714073216:12345-0@lo:400:kworker.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364834.317339:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787364834.317367:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787364834.317371:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787364834.317465:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787364834.317475:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714073344:0@lo:400:kworker.0 00000100:00100000:3.0:1787364834.317504:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364834.317532:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714073344 00000100:00100000:3.0:1787364834.317535:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714073344 00000100:00100000:3.0:1787364834.317568:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787364834.317576:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714073344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364834.317609:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714073344:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364834.317616:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787364834.317631:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787364834.317649:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34451880 x1874187714073344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364834.317659:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714073344:0@lo:400:kworker.0 00000100:00100000:0.0:1787364834.317756:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714073088:12345-0@lo:400:kworker.0 Request processed in 551us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364834.317763:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787364834.317813:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714073216:0@lo:400:kworker.0 00010000:00080000:1.0:1787364834.317889:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34451500 x1874187714073088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364834.317899:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714073088:0@lo:400:kworker.0 00010000:00010000:1.0:1787364834.826976:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364834.827957:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364834.827978:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714073472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364834.828044:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364834.828111:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714073472 00000100:00100000:2.0:1787364834.828119:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714073472 00000100:00100000:2.0:1787364834.828160:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787364834.828184:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714073472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787364834.828218:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364834.828264:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714073472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364834.828271:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787364834.828311:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd0380 x1874187714073472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364834.828329:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714073472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364834.829469:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714073600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364834.829517:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364834.829724:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714073600 00000100:00100000:1.0:1787364834.829731:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714073600 00000100:00100000:1.0:1787364834.829776:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787364834.829806:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714073600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787364834.829845:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364834.829893:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714073600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364834.829900:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787364834.829933:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fddad80 x1874187714073600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364834.829948:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714073600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364835.851003:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364836.636030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364836.636066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364836.636098:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688877312 00000100:00100000:1.0:1787364836.636108:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688877312 00000100:00100000:1.0:1787364836.636167:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:1.0:1787364836.636176:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2365:x1874187688877312:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364836.636248:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2365:x1874187688877312:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364836.636255:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00080000:1.0:1787364836.636275:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787364836.637080:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688877056 00000100:00100000:3.0:1787364836.637086:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688877056 00000100:00100000:3.0:1787364836.637138:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 194 00000100:00100000:3.0:1787364836.637146:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688877056:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364836.637261:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688877056:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 115us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364836.637267:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 194 00000100:00100000:1.0:1787364836.638178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364836.638254:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688877184 00000100:00100000:3.0:1787364836.638260:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688877184 00000100:00100000:3.0:1787364836.638316:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:3.0:1787364836.638326:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688877184:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364836.638378:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688877184:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 54us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364836.638384:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00080000:1.0:1787364836.638446:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364836.643867:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364836.644037:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688877440 00000100:00100000:3.0:1787364836.644046:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688877440 00000100:00100000:3.0:1787364836.644119:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:3.0:1787364836.644130:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:2364:x1874187688877440:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364836.644196:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:2364:x1874187688877440:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 68us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364836.644203:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00080000:1.0:1787364836.644266:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787364836.874897:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787364837.711547:0:8824:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787364837.898906:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364838.923522:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364839.439985:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714074112:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440068:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364839.440134:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787364839.440139:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714073728:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440167:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364839.440187:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714074240:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440211:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364839.440241:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714073856:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364839.440280:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714074368:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440301:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364839.440321:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364839.440325:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714073984:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440360:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364839.440393:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714074112 00000100:00100000:1.0:1787364839.440400:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714074112 00000100:00100000:1.0:1787364839.440452:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714074368 00000100:00100000:1.0:1787364839.440456:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714074368 00000100:00100000:1.0:1787364839.440482:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787364839.440491:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714074112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440552:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714074112:12345-0@lo:400:kworker.0 Request processed in 62us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364839.440560:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787364839.440578:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787364839.440585:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714074368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440614:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714074368:12345-0@lo:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364839.440621:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787364839.440639:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714073728 00000100:00100000:1.0:1787364839.440642:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714073728 00000100:00100000:1.0:1787364839.440671:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787364839.440677:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714073728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440706:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714073728:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364839.440712:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787364839.440738:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714074240 00000100:00100000:1.0:1787364839.440742:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714074240 00000100:00100000:1.0:1787364839.440779:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714073856 00000100:00100000:1.0:1787364839.440783:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714073856 00000100:00100000:1.0:1787364839.440817:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714073984 00000100:00100000:1.0:1787364839.440820:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714073984 00000100:00100000:1.0:1787364839.440833:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787364839.440839:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714074240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440871:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714074240:12345-0@lo:400:kworker.0 Request processed in 32us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364839.440877:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787364839.440887:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787364839.440900:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714073856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440929:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714073856:12345-0@lo:400:kworker.0 Request processed in 31us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364839.440935:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787364839.440946:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787364839.440952:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714073984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.440977:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714073984:12345-0@lo:400:kworker.0 Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364839.440983:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787364839.441006:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787364839.441011:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364839.441012:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364839.441043:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714073984:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.441054:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714073856:0@lo:400:kworker.0 00010000:00080000:1.0:1787364839.441065:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34241180 x1874187714074368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364839.441074:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714074368:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.441101:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714073728:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.441111:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714074240:0@lo:400:kworker.0 00010000:00080000:1.0:1787364839.441120:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fdd8380 x1874187714074112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364839.441129:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714074112:0@lo:400:kworker.0 00000100:00100000:1.0:1787364839.957381:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714074496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364839.957492:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787364839.957600:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364839.957617:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714074496 00000100:00100000:1.0:1787364839.957626:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714074496 00000100:00100000:1.0:1787364839.957689:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787364839.957700:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714074496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787364839.957757:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364839.957834:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714074496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364839.957843:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787364839.958144:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34241180 x1874187714074496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364839.958169:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714074496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364839.968338:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787364839.968372:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714074624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364839.968472:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364839.968555:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714074624 00000100:00100000:1.0:1787364839.968576:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714074624 00000100:00100000:1.0:1787364839.968639:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787364839.968650:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714074624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364839.968701:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364839.968775:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714074624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364839.968821:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787364839.968872:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34241180 x1874187714074624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364839.971007:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714074624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787364840.972648:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364841.757008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364841.757070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364841.757174:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688877696 00000100:00100000:2.0:1787364841.757187:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688877696 00000100:00100000:2.0:1787364841.757265:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:2.0:1787364841.757276:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688877696:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364841.757368:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688877696:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 93us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364841.757375:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:3.0:1787364841.758522:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688877568 00000100:00100000:3.0:1787364841.758537:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688877568 00000100:00100000:3.0:1787364841.758616:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 196 00000100:00100000:3.0:1787364841.758630:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2364:x1874187688877568:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364841.759532:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2364:x1874187688877568:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 899us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364841.759563:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 196 00000100:00080000:1.0:1787364841.761689:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364841.785226:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364841.785279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364841.785317:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688877824 00000100:00100000:1.0:1787364841.785332:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688877824 00000100:00100000:1.0:1787364841.785418:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688877952 00000100:00100000:1.0:1787364841.785422:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688877952 00000100:00100000:1.0:1787364841.785452:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:1.0:1787364841.785464:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2363:x1874187688877824:12345-192.168.204.2@tcp:9:kworker.0 00000020:00000080:1.0:1787364841.785514:0:8229:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ae56 00000100:00080000:1.0:1787364841.785531:0:8229:0:(import.c:65:import_set_state_nolock()) ffff9b6d35510000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787364841.785588:0:8229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787364841.786875:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:0.0:1787364841.786896:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2363:x1874187688877952:12345-192.168.204.2@tcp:9:kworker.0 00000020:00000080:0.0:1787364841.786936:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ae5d 00000100:00080000:0.0:1787364841.786956:0:6709:0:(import.c:65:import_set_state_nolock()) ffff9b6d06370800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787364841.787016:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787364841.787418:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364841.787504:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+2:2363:x1874187688877952:12345-192.168.204.2@tcp:9:kworker.0 Request processed in 615us (2222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364841.787514:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00080000:0.0:1787364841.787591:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787364841.787597:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364841.787868:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+2:2363:x1874187688877824:12345-192.168.204.2@tcp:9:kworker.0 Request processed in 2385us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364841.787882:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00010000:00010000:0.0:1787364841.790612:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364841.995431:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364843.019250:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364844.043136:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787364844.099048:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:2.0:1787364844.099060:0:6733:0:(genops.c:885:class_export_put()) final put ffff9b6d35513800/6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:1.0:1787364844.100453:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d35513800/6b97b2b3-6991-434b-88a0-aee779536483 for lustre-OST0000 00000020:00000080:1.0:1787364844.100553:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d35510000 for lustre-OST0000 00000100:00100000:3.0:1787364844.564002:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714074880:0@lo:400:kworker.0 00000100:00100000:3.0:1787364844.564102:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364844.564206:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787364844.564217:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714074752:0@lo:400:kworker.0 00000100:00100000:3.0:1787364844.564218:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714074880 00000100:00100000:3.0:1787364844.564227:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714074880 00000100:00100000:2.0:1787364844.564256:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364844.564296:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714074752 00000100:00100000:2.0:1787364844.564300:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714074752 00000100:00100000:3.0:1787364844.564306:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787364844.564315:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714074880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364844.564329:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787364844.564346:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714074752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364844.564375:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714074880:12345-0@lo:400:kworker.0 Request processed in 59us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364844.564375:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714074752:12345-0@lo:400:kworker.0 Request processed in 29us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364844.564384:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787364844.564384:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787364844.564426:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714074880:0@lo:400:kworker.0 00000100:00100000:2.0:1787364844.564426:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714074752:0@lo:400:kworker.0 00000100:00100000:3.0:1787364844.564460:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787364844.564467:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714075008:0@lo:400:kworker.0 00000100:00100000:3.0:1787364844.564492:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364844.564566:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714075392:0@lo:400:kworker.0 00000100:00100000:2.0:1787364844.564676:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714075008 00000100:00100000:2.0:1787364844.564681:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714075008 00000100:00100000:2.0:1787364844.564721:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787364844.564728:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714075008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364844.564760:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714075008:12345-0@lo:400:kworker.0 Request processed in 34us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364844.564767:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787364844.564814:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714075136:0@lo:400:kworker.0 00000100:00100000:2.0:1787364844.564842:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364844.564865:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787364844.564870:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714075264:0@lo:400:kworker.0 00000100:00100000:2.0:1787364844.564910:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787364844.564938:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364844.564951:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714075264 00000100:00100000:2.0:1787364844.564955:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714075264 00000100:00100000:2.0:1787364844.564983:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787364844.565128:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714075264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364844.565135:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364844.565164:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714075008:0@lo:400:kworker.0 00000100:00100000:2.0:1787364844.565164:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714075264:12345-0@lo:400:kworker.0 Request processed in 174us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364844.565170:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787364844.565187:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714075392 00000100:00100000:2.0:1787364844.565187:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714075136 00000100:00100000:3.0:1787364844.565190:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714075392 00000100:00100000:2.0:1787364844.565196:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714075136 00000100:00100000:3.0:1787364844.565222:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787364844.565229:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714075392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364844.565266:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714075392:12345-0@lo:400:kworker.0 Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364844.565281:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787364844.566072:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787364844.566094:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714075136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364844.566144:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714075136:12345-0@lo:400:kworker.0 Request processed in 63us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364844.566151:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787364844.571342:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364844.571357:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364844.571362:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364844.571440:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714075264:0@lo:400:kworker.0 00010000:00080000:2.0:1787364844.571465:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34452d80 x1874187714075136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364844.571477:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714075136:0@lo:400:kworker.0 00010000:00080000:3.0:1787364844.575817:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34452300 x1874187714075392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364844.575840:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714075392:0@lo:400:kworker.0 00000100:00100000:3.0:1787364845.073162:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787364845.073208:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714075520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364845.073312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364845.084900:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714075520 00000100:00100000:1.0:1787364845.084924:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714075520 00000100:00100000:1.0:1787364845.085011:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787364845.085025:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714075520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364845.085079:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364845.085221:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714075520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (11909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364845.085230:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787364845.085259:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1787364845.085332:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34452300 x1874187714075520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364845.085359:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714075520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364845.085459:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714075648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364845.085506:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364845.085560:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714075648 00000100:00100000:1.0:1787364845.085564:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714075648 00000100:00100000:1.0:1787364845.085588:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787364845.085595:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714075648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787364845.085619:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364845.085663:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714075648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364845.085670:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787364845.085694:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34242d80 x1874187714075648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364845.085706:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714075648:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787364845.157997:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:2.0:1787364845.158159:0:7661:0:(genops.c:885:class_export_put()) final put ffff9b6d06377800/6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:3.0:1787364845.160739:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d06377800/6b97b2b3-6991-434b-88a0-aee779536483 for lustre-OST0001 00000020:00000080:3.0:1787364845.160848:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d06370800 for lustre-OST0001 00000001:02000400:1.0:1787364845.270917:0:9069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing yml_node 00010000:00010000:2.0:1787364846.090977:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364846.872937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364846.872974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364846.872999:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688878080 00000100:00100000:2.0:1787364846.873009:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688878080 00000100:00100000:2.0:1787364846.873072:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 198 00000100:00100000:2.0:1787364846.873084:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688878080:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364846.873164:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688878080:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364846.873172:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 198 00000100:00100000:2.0:1787364846.873205:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688878208 00000100:00100000:2.0:1787364846.873209:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688878208 00000100:00100000:2.0:1787364846.873252:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:2.0:1787364846.873260:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688878208:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364846.873292:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688878208:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364846.873310:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00080000:2.0:1787364846.873328:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787364847.115237:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364848.139078:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364849.165949:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364849.675371:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714075904:0@lo:400:kworker.0 00000100:00100000:3.0:1787364849.675385:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714076032:0@lo:400:kworker.0 00000100:00100000:1.0:1787364849.675499:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714075776:0@lo:400:kworker.0 00000100:00100000:0.0:1787364849.675568:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714076160:0@lo:400:kworker.0 00000100:00100000:3.0:1787364849.676700:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364849.676803:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714076032 00000100:00100000:3.0:1787364849.676811:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714076032 00000100:00100000:3.0:1787364849.676863:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787364849.676873:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714076032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364849.676920:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714076032:12345-0@lo:400:kworker.0 Request processed in 50us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364849.676926:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787364849.676961:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714076032:0@lo:400:kworker.0 00000100:00080000:3.0:1787364849.677001:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364849.679340:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364849.679465:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714076416:0@lo:400:kworker.0 00000100:00100000:2.0:1787364849.679503:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364849.679634:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714076416 00000100:00100000:2.0:1787364849.679643:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714076416 00000100:00100000:3.0:1787364849.679660:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714075904 00000100:00100000:3.0:1787364849.679666:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714075904 00000100:00100000:3.0:1787364849.679814:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787364849.679824:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714075904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364849.679885:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714075904:12345-0@lo:400:kworker.0 Request processed in 63us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364849.679892:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787364849.679930:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787364849.679962:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714075904:0@lo:400:kworker.0 00000100:00100000:2.0:1787364849.680619:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787364849.680631:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714076416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364849.680690:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714076416:12345-0@lo:400:kworker.0 Request processed in 62us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364849.680696:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787364849.681451:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34451500 x1874187714076416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364849.681465:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714076416:0@lo:400:kworker.0 00000100:00100000:1.0:1787364849.683585:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364849.683663:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714076288:0@lo:400:kworker.0 00000100:00100000:1.0:1787364849.683706:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364849.687408:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714076288 00000100:00100000:3.0:1787364849.687424:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714076288 00000100:00100000:3.0:1787364849.687525:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787364849.687535:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714076288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364849.687645:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714076288:12345-0@lo:400:kworker.0 Request processed in 111us (3937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364849.687652:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787364849.687708:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714076288:0@lo:400:kworker.0 00000100:00100000:2.0:1787364849.688366:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714075776 00000100:00100000:2.0:1787364849.688374:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714075776 00000100:00100000:2.0:1787364849.688421:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787364849.688431:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714075776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364849.688480:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714075776:12345-0@lo:400:kworker.0 Request processed in 51us (4912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364849.688487:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787364849.689152:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714075776:0@lo:400:kworker.0 00000100:00080000:1.0:1787364849.690372:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364849.693123:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364849.693367:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714076160 00000100:00100000:2.0:1787364849.693377:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714076160 00000100:00100000:2.0:1787364849.693444:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787364849.693453:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714076160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364849.693513:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714076160:12345-0@lo:400:kworker.0 Request processed in 62us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364849.693533:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787364849.696161:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787364849.696219:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34450000 x1874187714076160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364849.696236:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714076160:0@lo:400:kworker.0 00010000:00010000:1.0:1787364850.187066:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364850.187139:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714076544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364850.187209:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364850.187274:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714076544 00000100:00100000:0.0:1787364850.187281:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714076544 00000100:00100000:0.0:1787364850.187322:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787364850.187330:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714076544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787364850.187361:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364850.187399:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714076544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364850.187405:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787364850.187443:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34243b80 x1874187714076544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364850.187479:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714076544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364850.187590:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364850.187601:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714076672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364850.187637:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364850.187819:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714076672 00000100:00100000:1.0:1787364850.187824:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714076672 00000100:00100000:1.0:1787364850.187853:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787364850.187860:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714076672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364850.187878:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364850.187914:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714076672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364850.187920:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787364850.188505:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34450700 x1874187714076672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364850.188523:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714076672:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787364851.015279:0:9262:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.47 00010000:00010000:1.0:1787364851.211032:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364851.994610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364851.994661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364851.994743:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688878336 00000100:00100000:1.0:1787364851.994756:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688878336 00000100:00100000:1.0:1787364851.994859:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 200 00000100:00100000:1.0:1787364851.994871:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2364:x1874187688878336:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364851.994958:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2364:x1874187688878336:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364851.994966:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 200 00000100:00100000:3.0:1787364851.995041:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688878464 00000100:00100000:3.0:1787364851.995045:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688878464 00000100:00100000:3.0:1787364851.995101:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:3.0:1787364851.995111:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688878464:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364851.995142:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688878464:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 35us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364851.995149:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00080000:1.0:1787364851.995207:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787364852.237842:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364853.260371:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787364854.192687:0:9360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.47 00010000:00010000:1.0:1787364854.308523:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364854.802287:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714076800:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.802385:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364854.802521:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714076800 00000100:00100000:1.0:1787364854.802532:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714076800 00000100:00100000:1.0:1787364854.802599:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787364854.802611:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714076800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364854.802692:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714076800:12345-0@lo:400:kworker.0 Request processed in 83us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364854.802701:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787364854.802918:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714076800:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.802926:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714077312:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.802960:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364854.803006:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364854.803014:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714077184:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.803040:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364854.803074:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714076928:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.803099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364854.803116:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714077440:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.803136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364854.803168:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787364854.803173:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714077056:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.803198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364854.803225:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714077184 00000100:00100000:3.0:1787364854.803230:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714077184 00000100:00100000:3.0:1787364854.803277:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714077440 00000100:00100000:3.0:1787364854.803280:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714077440 00000100:00100000:3.0:1787364854.803302:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787364854.803310:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714077184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.803352:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714077184:12345-0@lo:400:kworker.0 Request processed in 43us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364854.803359:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787364854.803373:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787364854.803380:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714077440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.803409:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714077440:12345-0@lo:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364854.803415:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787364854.803536:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714077312 00000100:00100000:1.0:1787364854.803541:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714077312 00000100:00100000:1.0:1787364854.811618:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714076928 00000100:00100000:1.0:1787364854.811643:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714076928 00000100:00100000:1.0:1787364854.811690:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714077056 00000100:00100000:1.0:1787364854.811694:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714077056 00000100:00100000:1.0:1787364854.811899:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787364854.811913:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714077312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364854.812043:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714077312:12345-0@lo:400:kworker.0 Request processed in 133us (9082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364854.812052:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787364854.812073:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787364854.812080:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714076928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364854.812114:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714076928:12345-0@lo:400:kworker.0 Request processed in 35us (9014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364854.812121:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787364854.812133:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787364854.812141:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714077056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364854.812172:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714077056:12345-0@lo:400:kworker.0 Request processed in 33us (8973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364854.812179:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787364854.812542:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787364854.812550:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787364854.812553:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787364854.812611:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34240000 x1874187714077184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364854.812629:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714077184:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.812644:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714077312:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.812690:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714077056:0@lo:400:kworker.0 00000100:00100000:3.0:1787364854.812704:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714076928:0@lo:400:kworker.0 00010000:00080000:3.0:1787364854.812746:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34243b80 x1874187714077440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364854.812756:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714077440:0@lo:400:kworker.0 00000100:00100000:0.0:1787364855.311714:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714077568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364855.311835:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364855.311937:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714077568 00000100:00100000:0.0:1787364855.311946:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714077568 00000100:00100000:0.0:1787364855.312005:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787364855.312015:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714077568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787364855.312060:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364855.312112:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714077568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364855.312121:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787364855.312171:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d07d2d880 x1874187714077568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364855.312191:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714077568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364855.321612:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364855.321648:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714077696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364855.321752:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364855.322185:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714077696 00000100:00100000:2.0:1787364855.322196:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714077696 00000100:00100000:2.0:1787364855.322269:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787364855.322281:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714077696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364855.322331:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364855.322412:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714077696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364855.322421:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787364855.322479:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c078d7800 x1874187714077696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364855.322501:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714077696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364855.389198:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364856.395299:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364857.118048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364857.118145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364857.121004:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688878592 00000100:00100000:1.0:1787364857.121113:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688878592 00000100:00100000:1.0:1787364857.121206:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 202 00000100:00100000:1.0:1787364857.121221:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688878592:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364857.121531:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688878592:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 311us (3499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364857.121541:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 202 00000100:00100000:1.0:1787364857.121594:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688878720 00000100:00100000:1.0:1787364857.121599:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688878720 00000100:00100000:1.0:1787364857.121762:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:1.0:1787364857.121769:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688878720:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364857.121825:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688878720:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 56us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364857.121832:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00080000:0.0:1787364857.122059:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787364857.343057:0:9457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.47 00010000:00010000:1.0:1787364857.421140:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364858.442965:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364859.467081:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787364859.551131:0:9505:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 21 22:14:16 EDT 2026 00000100:00100000:3.0:1787364859.915525:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714077824:0@lo:400:kworker.0 00000100:00100000:1.0:1787364859.915527:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714077952:0@lo:400:kworker.0 00000100:00100000:0.0:1787364859.915616:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714078208:0@lo:400:kworker.0 00000100:00100000:1.0:1787364859.915747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364859.915867:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714078464:0@lo:400:kworker.0 00000100:00100000:1.0:1787364859.915895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364859.915922:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364859.915927:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714078080:0@lo:400:kworker.0 00000100:00100000:1.0:1787364859.915948:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364859.915996:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714078464 00000100:00100000:1.0:1787364859.916005:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714078464 00000100:00100000:1.0:1787364859.916079:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787364859.916109:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714078464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364859.916172:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714078464:12345-0@lo:400:kworker.0 Request processed in 66us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364859.916180:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787364859.916208:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714077952 00000100:00100000:1.0:1787364859.916211:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714077952 00000100:00100000:1.0:1787364859.916237:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714078080 00000100:00100000:1.0:1787364859.916239:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714078080 00000100:00100000:1.0:1787364859.916261:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787364859.916280:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714077952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364859.916315:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714077952:12345-0@lo:400:kworker.0 Request processed in 48us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364859.916322:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787364859.917328:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364859.917397:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787364859.917399:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787364859.917411:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714078336:0@lo:400:kworker.0 00000100:00100000:2.0:1787364859.917413:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714078080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364859.917443:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364859.917457:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714078080:12345-0@lo:400:kworker.0 Request processed in 50us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364859.917464:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787364859.917478:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714078208 00000100:00100000:2.0:1787364859.917480:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714078336 00000100:00100000:2.0:1787364859.917487:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714078336 00000100:00100000:0.0:1787364859.917492:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714078208 00000100:00100000:2.0:1787364859.917513:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787364859.917519:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714078336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364859.917522:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787364859.917527:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714078208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364859.917552:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714078336:12345-0@lo:400:kworker.0 Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364859.917553:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714078208:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364859.917560:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787364859.917564:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787364859.917608:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714078336:0@lo:400:kworker.0 00010000:00080000:0.0:1787364859.917623:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c078d5c00 x1874187714078208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364859.917634:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714078208:0@lo:400:kworker.0 00000100:00080000:1.0:1787364859.919559:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787364859.919584:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787364859.919589:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787364859.919666:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714078080:0@lo:400:kworker.0 00010000:00080000:1.0:1787364859.919692:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c078d6d80 x1874187714078464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364859.919704:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714078464:0@lo:400:kworker.0 00000100:00100000:1.0:1787364859.919717:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714077952:0@lo:400:kworker.0 00000100:00100000:3.0:1787364859.919801:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364859.920949:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714077824 00000100:00100000:1.0:1787364859.920965:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714077824 00000100:00100000:1.0:1787364859.921043:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787364859.921055:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714077824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364859.921172:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714077824:12345-0@lo:400:kworker.0 Request processed in 120us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364859.921199:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787364859.921484:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714077824:0@lo:400:kworker.0 00000100:00100000:3.0:1787364860.430279:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714078592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364860.430401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364860.430465:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714078592 00000100:00100000:1.0:1787364860.430477:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714078592 00000100:00100000:3.0:1787364860.430612:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787364860.430637:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714078592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364860.430686:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364860.430743:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714078592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364860.430752:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787364860.430987:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34453480 x1874187714078592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364860.431025:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714078592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364860.431577:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364860.431596:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714078720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364860.431697:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364860.431744:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714078720 00000100:00100000:3.0:1787364860.431750:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714078720 00000100:00100000:3.0:1787364860.432236:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787364860.432249:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714078720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364860.432300:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364860.432377:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714078720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364860.432384:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787364860.432433:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34242300 x1874187714078720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364860.432454:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714078720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364860.490983:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364861.514945:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364862.233513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364862.233652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364862.233833:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688878848 00000100:00100000:3.0:1787364862.233846:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688878848 00000100:00100000:3.0:1787364862.233924:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 204 00000100:00100000:3.0:1787364862.233937:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688878848:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364862.234058:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688878848:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 124us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364862.234067:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 204 00000100:00100000:0.0:1787364862.236496:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688878976 00000100:00100000:0.0:1787364862.236513:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688878976 00000100:00100000:0.0:1787364862.236620:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00100000:0.0:1787364862.236634:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688878976:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364862.236732:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688878976:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 102us (3080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364862.236740:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00080000:3.0:1787364862.239015:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787364862.541966:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364863.563941:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364864.587218:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364865.035101:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714078848:0@lo:400:kworker.0 00000100:00100000:2.0:1787364865.035206:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364865.035239:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714079232:0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.035296:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364865.035298:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714079360:0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.035335:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714078976:0@lo:400:kworker.0 00000100:00100000:2.0:1787364865.035340:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364865.035362:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364865.035378:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714078848 00000100:00100000:0.0:1787364865.035379:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714079488:0@lo:400:kworker.0 00000100:00100000:2.0:1787364865.035388:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714078848 00000100:00100000:0.0:1787364865.035400:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364865.035429:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364865.035435:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714079104:0@lo:400:kworker.0 00000100:00100000:2.0:1787364865.035445:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787364865.035455:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714078848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.035456:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364865.035492:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714079232 00000100:00100000:0.0:1787364865.035496:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714079232 00000100:00100000:2.0:1787364865.035514:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714078848:12345-0@lo:400:kworker.0 Request processed in 60us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364865.035524:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787364865.035548:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714079488 00000100:00100000:0.0:1787364865.035551:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714079488 00000100:00100000:2.0:1787364865.035565:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714079360 00000100:00100000:2.0:1787364865.035569:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714079360 00000100:00100000:0.0:1787364865.035573:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787364865.035578:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714079232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364865.035594:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714078976 00000100:00100000:2.0:1787364865.035597:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714078976 00000100:00100000:2.0:1787364865.035610:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714079104 00000100:00100000:2.0:1787364865.035612:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714079104 00000100:00100000:0.0:1787364865.035618:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714079232:12345-0@lo:400:kworker.0 Request processed in 40us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364865.035637:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787364865.035651:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787364865.035657:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714079488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.035691:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714079488:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364865.035697:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787364865.035729:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787364865.035738:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714079360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.035768:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714079360:12345-0@lo:400:kworker.0 Request processed in 32us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364865.035774:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787364865.035818:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787364865.035825:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714078976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.035859:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714078976:12345-0@lo:400:kworker.0 Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364865.035865:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787364865.035926:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4e680 x1874187714079232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364865.035942:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714079232:0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.035972:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714078976:0@lo:400:kworker.0 00010000:00080000:0.0:1787364865.035982:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4d880 x1874187714079488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364865.035990:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714079488:0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.036044:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714079360:0@lo:400:kworker.0 00000100:00100000:0.0:1787364865.036054:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714078848:0@lo:400:kworker.0 00000100:00100000:2.0:1787364865.036261:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787364865.036281:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714079104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364865.036327:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714079104:12345-0@lo:400:kworker.0 Request processed in 60us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364865.036334:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787364865.036380:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714079104:0@lo:400:kworker.0 00000100:00080000:3.0:1787364865.036818:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787364865.036825:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787364865.036827:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787364865.547466:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714079616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364865.547578:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364865.547694:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714079616 00000100:00100000:0.0:1787364865.547705:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714079616 00000100:00100000:0.0:1787364865.547805:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787364865.547817:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714079616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787364865.547868:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364865.547948:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714079616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364865.547958:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787364865.550362:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34240000 x1874187714079616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364865.550398:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714079616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364865.555294:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714079744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364865.555411:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364865.557067:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714079744 00000100:00100000:3.0:1787364865.557084:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714079744 00000100:00100000:3.0:1787364865.557158:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787364865.557173:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714079744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364865.557723:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1787364865.558071:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34242a00 x1874187714079744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364865.558119:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714079744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364865.558271:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714079744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1017us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364865.558283:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1787364865.616735:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364866.636032:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364867.360713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364867.360884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364867.361771:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688879232 00000100:00100000:0.0:1787364867.361823:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688879232 00000100:00100000:0.0:1787364867.361930:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00100000:0.0:1787364867.361944:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688879232:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364867.362055:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688879232:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 114us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364867.362064:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00080000:2.0:1787364867.363019:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364867.367696:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688879104 00000100:00100000:3.0:1787364867.367717:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688879104 00000100:00100000:2.0:1787364867.372868:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 206 00000100:00100000:2.0:1787364867.372888:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688879104:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364867.373002:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688879104:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 119us (12304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364867.373010:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 206 00010000:00010000:0.0:1787364867.659054:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364868.683190:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364869.707783:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364870.161632:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714079872:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.161711:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364870.161756:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714080384:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.161781:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364870.161821:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787364870.161827:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714080256:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.161850:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364870.161876:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714080000:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.161898:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364870.161915:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714080512:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.161935:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364870.162496:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364870.162505:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714080128:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.162539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364870.162578:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714079872 00000100:00100000:2.0:1787364870.162586:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714079872 00000100:00100000:2.0:1787364870.162629:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787364870.162638:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714079872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.162689:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714079872:12345-0@lo:400:kworker.0 Request processed in 52us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364870.162697:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787364870.162730:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714080384 00000100:00100000:2.0:1787364870.162734:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714080384 00000100:00100000:2.0:1787364870.162767:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714080000 00000100:00100000:2.0:1787364870.162770:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714080000 00000100:00100000:2.0:1787364870.162780:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714080128 00000100:00100000:2.0:1787364870.162782:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714080128 00000100:00100000:2.0:1787364870.164764:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787364870.164779:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714080384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.164878:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714080384:12345-0@lo:400:kworker.0 Request processed in 103us (3095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364870.164885:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787364870.164902:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787364870.164908:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714080000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.164951:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714080000:12345-0@lo:400:kworker.0 Request processed in 43us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364870.164957:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787364870.164969:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787364870.164975:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714080128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.165004:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714080128:12345-0@lo:400:kworker.0 Request processed in 30us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364870.165022:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787364870.165058:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714080256 00000100:00100000:1.0:1787364870.165058:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714080128:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.165066:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714080256 00000100:00100000:1.0:1787364870.165078:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714080000:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.165118:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714080512 00000100:00100000:2.0:1787364870.165123:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714080512 00000100:00100000:2.0:1787364870.165170:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787364870.165176:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714080256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364870.165195:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787364870.165208:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714080512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.165215:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714080256:12345-0@lo:400:kworker.0 Request processed in 38us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364870.165223:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787364870.165261:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714080512:12345-0@lo:400:kworker.0 Request processed in 57us (3323us total) trans 0 rc 0/0 00000100:00080000:2.0:1787364870.165262:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364870.165267:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364870.165271:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364870.165273:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787364870.165307:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c078d4000 x1874187714080256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787364870.165311:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c078d7800 x1874187714080512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364870.165323:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714080256:0@lo:400:kworker.0 00000100:00100000:1.0:1787364870.165340:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714080512:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.165343:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714079872:0@lo:400:kworker.0 00000100:00100000:2.0:1787364870.165371:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714080384:0@lo:400:kworker.0 00000100:00100000:1.0:1787364870.667202:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364870.667225:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714080640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364870.667297:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364870.667370:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714080640 00000100:00100000:1.0:1787364870.667391:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714080640 00000100:00100000:1.0:1787364870.667437:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787364870.667445:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714080640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364870.667494:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364870.667539:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714080640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364870.667547:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787364870.667760:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34240000 x1874187714080640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364870.667779:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714080640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364870.672943:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364870.679698:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714080768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364870.680645:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364870.683250:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714080768 00000100:00100000:2.0:1787364870.683267:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714080768 00000100:00100000:2.0:1787364870.683366:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787364870.683378:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714080768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364870.683416:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364870.683518:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714080768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364870.683539:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787364870.683729:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34240000 x1874187714080768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364870.683750:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714080768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787364870.737273:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364871.755092:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364872.478816:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364872.479278:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688879488 00000100:00100000:3.0:1787364872.479288:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688879488 00000100:00100000:3.0:1787364872.479367:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 65 00000100:00100000:3.0:1787364872.479378:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688879488:12345-192.168.204.2@tcp:400:kworker.0 00000100:00080000:2.0:1787364872.479563:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364872.479605:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688879488:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 228us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364872.479614:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 65 00000100:00100000:0.0:1787364872.493665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364872.496064:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688879360 00000100:00100000:3.0:1787364872.496077:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688879360 00000100:00100000:3.0:1787364872.496157:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 208 00000100:00100000:3.0:1787364872.496168:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688879360:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364872.496250:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688879360:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 83us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364872.496257:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 208 00010000:00010000:3.0:1787364872.782214:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364873.808346:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364874.828649:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364875.278740:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787364875.278945:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714081024:0@lo:400:kworker.0 00000100:00100000:1.0:1787364875.279078:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364875.279163:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364875.279170:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714081152:0@lo:400:kworker.0 00000100:00100000:1.0:1787364875.279196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364875.279242:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714081024 00000100:00100000:1.0:1787364875.279253:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714081024 00000100:00100000:1.0:1787364875.279309:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714081152 00000100:00100000:1.0:1787364875.279326:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714081152 00000100:00100000:1.0:1787364875.279365:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787364875.279374:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714081024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364875.279436:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714081024:12345-0@lo:400:kworker.0 Request processed in 62us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364875.279444:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787364875.279465:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787364875.279472:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714081152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364875.279524:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714081152:12345-0@lo:400:kworker.0 Request processed in 53us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364875.279530:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787364875.279564:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364875.279601:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714081152:0@lo:400:kworker.0 00000100:00100000:1.0:1787364875.279614:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714081024:0@lo:400:kworker.0 00000100:00100000:3.0:1787364875.282066:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714081280:0@lo:400:kworker.0 00000100:00100000:3.0:1787364875.282180:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364875.282241:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714080896:0@lo:400:kworker.0 00000100:00100000:3.0:1787364875.282274:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364875.282461:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714081280 00000100:00100000:0.0:1787364875.282472:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714081280 00000100:00100000:0.0:1787364875.282557:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787364875.282571:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714081280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364875.282651:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714081280:12345-0@lo:400:kworker.0 Request processed in 83us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364875.282659:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787364875.282684:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364875.283202:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714080896 00000100:00100000:1.0:1787364875.283209:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714080896 00000100:00100000:1.0:1787364875.283248:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787364875.283257:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714080896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364875.283321:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714080896:12345-0@lo:400:kworker.0 Request processed in 66us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364875.283328:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00080000:2.0:1787364875.285671:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c078d4e00 x1874187714081280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364875.285693:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714081280:0@lo:400:kworker.0 00000100:00100000:2.0:1787364875.285709:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714080896:0@lo:400:kworker.0 00000100:00100000:2.0:1787364875.285743:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787364875.285753:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714081408:0@lo:400:kworker.0 00000100:00100000:2.0:1787364875.285862:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364875.285990:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787364875.286020:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714081536:0@lo:400:kworker.0 00000100:00100000:0.0:1787364875.286082:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364875.286349:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714081408 00000100:00100000:1.0:1787364875.286358:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714081408 00000100:00100000:1.0:1787364875.286433:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787364875.286445:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714081408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364875.286515:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714081408:12345-0@lo:400:kworker.0 Request processed in 72us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364875.286523:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787364875.286674:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364875.286730:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714081536 00000100:00100000:2.0:1787364875.286735:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714081536 00000100:00100000:2.0:1787364875.286803:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787364875.286812:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714081536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364875.286855:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714081536:12345-0@lo:400:kworker.0 Request processed in 45us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364875.286861:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787364875.286896:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714081408:0@lo:400:kworker.0 00000100:00080000:0.0:1787364875.286964:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787364875.286986:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c078d4000 x1874187714081536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364875.286997:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714081536:0@lo:400:kworker.0 00000100:00100000:0.0:1787364875.787353:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714081664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364875.787456:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364875.787810:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714081792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364875.787849:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364875.787941:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714081664 00000100:00100000:1.0:1787364875.787951:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714081664 00000100:00100000:1.0:1787364875.788018:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714081792 00000100:00100000:1.0:1787364875.788029:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714081792 00000100:00100000:1.0:1787364875.788058:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787364875.788068:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714081664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364875.788136:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364875.788197:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714081664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364875.788206:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787364875.788225:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787364875.788231:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714081792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787364875.788254:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364875.788285:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714081792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364875.788291:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787364875.788496:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fddb100 x1874187714081792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364875.788533:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714081792:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787364875.788727:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fdd8000 x1874187714081664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364875.788742:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714081664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787364875.851395:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364876.875316:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787364877.299443:0:10136:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:14:34 (1787364874) === 00000100:00100000:1.0:1787364877.598910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364877.598994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364877.599270:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688879744 00000100:00100000:3.0:1787364877.599285:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688879744 00000100:00100000:3.0:1787364877.599375:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:3.0:1787364877.599458:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688879744:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364877.599571:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688879744:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 186us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364877.599581:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:0.0:1787364877.601513:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688879616 00000100:00100000:0.0:1787364877.601534:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688879616 00000100:00100000:0.0:1787364877.601663:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 210 00000100:00100000:0.0:1787364877.601675:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688879616:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364877.601763:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2365:x1874187688879616:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 90us (2871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364877.601771:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 210 00000100:00080000:0.0:1787364877.601822:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364877.774580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364877.774825:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688879872 00000100:00100000:0.0:1787364877.774838:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688879872 00000100:00100000:0.0:1787364877.775060:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 211 00000100:00100000:0.0:1787364877.775076:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+10:8139:x1874187688879872:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787364877.775126:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364877.775152:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e5600/0xcfc9272e5fc2af21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67da93 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364877.775192:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e5600/0xcfc9272e5fc2af21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da93 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364877.775206:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e5600/0xcfc9272e5fc2af21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da93 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364877.775218:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5600, rc 0) 00000100:00100000:0.0:1787364877.775305:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+11:8139:x1874187688879872:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 234us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364877.775314:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 211 00000100:00100000:0.0:1787364877.788968:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364877.789155:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688880000 00000100:00100000:1.0:1787364877.789169:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688880000 00000100:00100000:1.0:1787364877.789246:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 212 00000100:00100000:1.0:1787364877.789260:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+11:8139:x1874187688880000:12345-192.168.204.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787364877.789693:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+11:8139:x1874187688880000:12345-192.168.204.2@tcp:501:mount.lustre.0 Request processed in 435us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364877.789703:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 212 00000100:00100000:1.0:1787364877.793258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364877.794415:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688880128 00000100:00100000:0.0:1787364877.794431:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688880128 00000100:00100000:0.0:1787364877.794520:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 213 00000100:00100000:0.0:1787364877.794532:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+11:8139:x1874187688880128:12345-192.168.204.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787364877.795196:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+11:8139:x1874187688880128:12345-192.168.204.2@tcp:503:mount.lustre.0 Request processed in 660us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364877.795208:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 213 00000100:00100000:3.0:1787364877.802061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364877.803278:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688880256 00000100:00100000:2.0:1787364877.803294:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688880256 00000100:00100000:2.0:1787364877.803381:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 214 00000100:00100000:2.0:1787364877.803408:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+11:8143:x1874187688880256:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787364877.803845:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+11:8143:x1874187688880256:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 440us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364877.803854:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 214 00000100:00100000:2.0:1787364877.826633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364877.830695:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688880384 00000100:00100000:1.0:1787364877.830719:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688880384 00000100:00100000:1.0:1787364877.830890:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 215 00000100:00100000:1.0:1787364877.830913:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+11:8143:x1874187688880384:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787364877.831353:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+11:8143:x1874187688880384:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 451us (4735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364877.831365:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 215 00000100:00100000:1.0:1787364877.841136:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364877.848365:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688880512 00000100:00100000:0.0:1787364877.848515:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688880512 00000100:00100000:2.0:1787364877.855815:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 216 00000100:00100000:2.0:1787364877.855834:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+11:8139:x1874187688880512:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787364877.855860:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364877.859540:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2af28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dabd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364877.859598:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2af28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dabd expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364877.859612:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2af28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dabd expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364877.859623:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35c00, rc 0) 00000100:00100000:2.0:1787364877.859701:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+12:8139:x1874187688880512:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 3869us (18580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364877.859729:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 216 00000100:00100000:3.0:1787364877.863136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364877.863282:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688880640 00000100:00100000:2.0:1787364877.863292:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688880640 00000100:00100000:2.0:1787364877.863361:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 217 00000100:00100000:2.0:1787364877.863371:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:8139:x1874187688880640:12345-192.168.204.2@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787364877.863399:0:5849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787364877.863425:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787364877.863430:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787364877.863434:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787364877.863436:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787364877.869574:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:8139:x1874187688880640:12345-192.168.204.2@tcp:256:mount.lustre.0 Request processed in 6194us (6437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364877.869590:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 217 00000100:00100000:3.0:1787364877.874926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364877.875336:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688880768 00000100:00100000:2.0:1787364877.875347:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688880768 00000100:00100000:2.0:1787364877.875407:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 218 00000100:00100000:2.0:1787364877.875417:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+12:8139:x1874187688880768:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787364877.875434:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364877.875451:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dac4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364877.875483:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364877.875494:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364877.875520:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35000, rc 0) 00000100:00100000:2.0:1787364877.875568:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:8139:x1874187688880768:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 153us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364877.875576:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 218 00000100:00100000:1.0:1787364877.877648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364877.877824:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688880896 00000100:00100000:2.0:1787364877.877834:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688880896 00000100:00100000:2.0:1787364877.877881:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 219 00000100:00100000:2.0:1787364877.877892:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:8139:x1874187688880896:12345-192.168.204.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787364877.878250:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:8139:x1874187688880896:12345-192.168.204.2@tcp:501:mount.lustre.0 Request processed in 359us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364877.878258:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 219 00000100:00100000:0.0:1787364877.888906:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364877.889003:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688881024 00000100:00100000:1.0:1787364877.889013:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688881024 00000100:00100000:1.0:1787364877.889073:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 220 00000100:00100000:1.0:1787364877.889083:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:8139:x1874187688881024:12345-192.168.204.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787364877.889412:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:8139:x1874187688881024:12345-192.168.204.2@tcp:503:mount.lustre.0 Request processed in 329us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364877.889421:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 220 00000100:00100000:1.0:1787364877.899152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364877.899230:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688881152 00000100:00100000:1.0:1787364877.899240:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688881152 00000100:00100000:1.0:1787364877.899299:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 221 00000100:00100000:1.0:1787364877.899309:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:8147:x1874187688881152:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787364877.899573:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:8147:x1874187688881152:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 264us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364877.899582:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 221 00010000:00010000:2.0:1787364877.899686:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364877.903145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364877.903884:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688881280 00000100:00100000:2.0:1787364877.903899:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688881280 00000100:00100000:2.0:1787364877.903984:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 222 00000100:00100000:2.0:1787364877.904006:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:8147:x1874187688881280:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787364877.904305:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:8147:x1874187688881280:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 311us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364877.904315:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 222 00000100:00100000:3.0:1787364877.911480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364877.911673:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688881408 00000100:00100000:1.0:1787364877.911688:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688881408 00000100:00100000:1.0:1787364877.911847:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:1.0:1787364877.911857:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2363:x1874187688881408:12345-192.168.204.2@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787364877.911892:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 41d9d144-3b1e-4bea-b859-eec032afe3d5@192.168.204.2@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:1.0:1787364877.911956:0:5856:0:(genops.c:1385:class_connect()) connect: client 41d9d144-3b1e-4bea-b859-eec032afe3d5, cookie 0xcfc9272e5fc2af36 00000004:00100000:1.0:1787364877.911991:0:5856:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787364877.912303:0:5856:0:(import.c:65:import_set_state_nolock()) ffff9b6c04a23800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787364877.912390:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2363:x1874187688881408:12345-192.168.204.2@tcp:38:mount.lustre.0 Request processed in 533us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364877.912399:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:1.0:1787364877.916595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364877.916859:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688881536 00000100:00100000:3.0:1787364877.916872:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688881536 00000100:00080000:0.0:1787364877.917053:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364877.917196:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:3.0:1787364877.917209:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:0:x1874187688881536:12345-192.168.204.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787364877.917277:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787364877.917410:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:0:x1874187688881536:12345-192.168.204.2@tcp:41:mount.lustre.0 Request processed in 203us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364877.917419:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:1.0:1787364877.923166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364877.923278:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688881664 00000100:00100000:0.0:1787364877.923310:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688881664 00000100:00100000:0.0:1787364877.923381:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:0.0:1787364877.923402:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:8139:x1874187688881664:12345-192.168.204.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787364877.923450:0:5857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787364877.923545:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:8139:x1874187688881664:12345-192.168.204.2@tcp:41:mount.lustre.0 Request processed in 154us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364877.923553:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:0.0:1787364877.929661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364877.931542:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688881792 00000100:00100000:1.0:1787364877.931563:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688881792 00000100:00100000:1.0:1787364877.931657:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:1.0:1787364877.931670:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:8139:x1874187688881792:12345-192.168.204.2@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787364877.931860:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:8139:x1874187688881792:12345-192.168.204.2@tcp:40:mount.lustre.0 Request processed in 192us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364877.931869:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:0.0:1787364877.936705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364877.936758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364877.936850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364877.936949:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688881920 00000100:00100000:3.0:1787364877.936963:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688881920 00000100:00100000:3.0:1787364877.937023:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688882048 00000100:00100000:3.0:1787364877.937027:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688882048 00000100:00100000:3.0:1787364877.937048:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:3.0:1787364877.937059:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1874187688881920:12345-192.168.204.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787364877.937105:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 41d9d144-3b1e-4bea-b859-eec032afe3d5@192.168.204.2@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:3.0:1787364877.937167:0:6710:0:(genops.c:1385:class_connect()) connect: client 41d9d144-3b1e-4bea-b859-eec032afe3d5, cookie 0xcfc9272e5fc2af3d 00002000:00100000:3.0:1787364877.937184:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 41d9d144-3b1e-4bea-b859-eec032afe3d5/ffff9b6d40f46000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787364877.937217:0:6710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787364877.937541:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787364877.937584:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9b6d40f47800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787364877.937670:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2363:x1874187688881920:12345-192.168.204.2@tcp:8:mount.lustre.0 Request processed in 610us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364877.937680:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:3.0:1787364877.937706:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:3.0:1787364877.937711:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1874187688882048:12345-192.168.204.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787364877.937750:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 41d9d144-3b1e-4bea-b859-eec032afe3d5@192.168.204.2@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:3.0:1787364877.937770:0:6710:0:(genops.c:1385:class_connect()) connect: client 41d9d144-3b1e-4bea-b859-eec032afe3d5, cookie 0xcfc9272e5fc2af44 00002000:00100000:3.0:1787364877.937776:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41d9d144-3b1e-4bea-b859-eec032afe3d5/ffff9b6d40f44800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787364877.937840:0:6710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787364877.938003:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787364877.938020:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9b6d40f40000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787364877.938047:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2363:x1874187688882048:12345-192.168.204.2@tcp:8:mount.lustre.0 Request processed in 335us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364877.938055:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:1.0:1787364877.938627:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688882176 00000100:00100000:1.0:1787364877.938637:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688882176 00000100:00100000:1.0:1787364877.938700:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:1.0:1787364877.938710:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:8139:x1874187688882176:12345-192.168.204.2@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787364877.939233:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787364877.942650:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:8139:x1874187688882176:12345-192.168.204.2@tcp:33:mount.lustre.0 Request processed in 681us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364877.942671:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 1 00010000:00010000:0.0:1787364878.926625:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364879.947253:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787364879.960479:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41d9d144-3b1e-4bea-b859-eec032afe3d5 00000100:00100000:1.0:1787364880.395989:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714082048:0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.396110:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364880.396191:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714082560:0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.396224:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364880.396268:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364880.396275:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714082176:0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.396301:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364880.396349:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714082048 00000100:00100000:1.0:1787364880.396359:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714082048 00000100:00100000:1.0:1787364880.396417:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714082176 00000100:00100000:1.0:1787364880.396421:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714082176 00000100:00100000:1.0:1787364880.396461:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787364880.396473:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714082048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.396542:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714082048:12345-0@lo:400:kworker.0 Request processed in 70us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364880.396550:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787364880.396571:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787364880.396577:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714082176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.396606:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714082176:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364880.396611:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787364880.396633:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714082560 00000100:00100000:1.0:1787364880.396636:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714082560 00000100:00100000:1.0:1787364880.396686:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787364880.396692:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714082560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.396727:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714082560:12345-0@lo:400:kworker.0 Request processed in 35us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364880.396733:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787364880.396758:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364880.396771:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364880.396844:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714082176:0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.396857:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714082048:0@lo:400:kworker.0 00010000:00080000:1.0:1787364880.396869:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc32300 x1874187714082560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364880.396879:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714082560:0@lo:400:kworker.0 00000100:00100000:3.0:1787364880.397013:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714082304:0@lo:400:kworker.0 00000100:00100000:3.0:1787364880.397061:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364880.397109:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787364880.397117:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714081920:0@lo:400:kworker.0 00000100:00100000:3.0:1787364880.397160:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364880.397183:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714082432:0@lo:400:kworker.0 00000100:00100000:3.0:1787364880.397208:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364880.398286:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714082304 00000100:00100000:1.0:1787364880.398298:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714082304 00000100:00100000:1.0:1787364880.398364:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787364880.398373:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714082304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.398466:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714082304:12345-0@lo:400:kworker.0 Request processed in 94us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364880.398474:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787364880.398499:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714081920 00000100:00100000:1.0:1787364880.398504:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714081920 00000100:00100000:1.0:1787364880.398534:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787364880.398540:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714081920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.398574:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714081920:12345-0@lo:400:kworker.0 Request processed in 34us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364880.398580:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787364880.398632:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714081920:0@lo:400:kworker.0 00000100:00080000:0.0:1787364880.398980:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787364880.399093:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714082432 00000100:00100000:0.0:1787364880.399098:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714082432 00000100:00100000:0.0:1787364880.399149:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787364880.399157:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714082432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364880.399202:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714082432:12345-0@lo:400:kworker.0 Request processed in 47us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364880.399209:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787364880.399262:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787364880.399364:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc30380 x1874187714082304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364880.399379:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714082304:0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.399426:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714082432:0@lo:400:kworker.0 00000100:00100000:1.0:1787364880.907999:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714082688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364880.908111:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364880.908225:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714082688 00000100:00100000:1.0:1787364880.908234:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714082688 00000100:00100000:1.0:1787364880.908299:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787364880.908310:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714082688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364880.908357:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364880.908410:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714082688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364880.908417:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787364880.908468:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc30000 x1874187714082688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364880.908491:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714082688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364880.917374:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714082816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364880.917484:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364880.920515:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714082816 00000100:00100000:2.0:1787364880.920537:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714082816 00000100:00100000:2.0:1787364880.921250:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787364880.921271:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714082816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364880.921350:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364880.925672:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714082816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4386us (8164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364880.925693:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787364880.938002:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4df80 x1874187714082816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364880.938036:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714082816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364880.972495:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787364881.017518:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41d9d144-3b1e-4bea-b859-eec032afe3d5 00010000:00010000:1.0:1787364881.997494:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787364882.002428:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41d9d144-3b1e-4bea-b859-eec032afe3d5 00010000:00010000:1.0:1787364883.018973:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364883.225634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364883.225697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364883.225731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364883.225842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364883.225870:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688882432 00000100:00100000:2.0:1787364883.225886:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688882432 00000100:00100000:0.0:1787364883.225898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364883.225946:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688882560 00000100:00100000:0.0:1787364883.225954:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688882560 00000100:00100000:2.0:1787364883.226022:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 73 00000100:00100000:2.0:1787364883.226044:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688882432:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364883.226087:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688882304 00000100:00100000:1.0:1787364883.226093:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688882304 00000100:00100000:1.0:1787364883.226138:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 224 00000100:00100000:2.0:1787364883.226146:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688882432:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 110us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364883.226153:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688882304:12345-192.168.204.2@tcp:400:kworker.0 00000100:00080000:3.0:1787364883.226296:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364883.227950:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688882304:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 1790us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364883.227965:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 224 00000100:00100000:0.0:1787364883.228271:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 74 00000100:00100000:2.0:1787364883.228314:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 73 00000100:00100000:0.0:1787364883.228317:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688882560:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364883.228399:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688882816 00000100:00100000:2.0:1787364883.228409:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688882816 00000100:00100000:0.0:1787364883.228951:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688882560:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 643us (3215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364883.228962:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 74 00000100:00100000:0.0:1787364883.229816:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688882688 00000100:00100000:0.0:1787364883.229830:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688882688 00000100:00100000:0.0:1787364883.229912:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:0.0:1787364883.229922:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2365:x1874187688882688:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364883.229984:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2365:x1874187688882688:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 63us (4097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364883.229992:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00080000:0.0:1787364883.230059:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787364883.236589:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:2.0:1787364883.236605:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688882816:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364883.236707:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688882816:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 105us (10925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364883.236720:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00080000:0.0:1787364883.236721:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787364884.043235:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364885.073143:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787364885.329090:0:10332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1787364885.529243:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714083072:0@lo:400:kworker.0 00000100:00100000:2.0:1787364885.529366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364885.529457:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714083584:0@lo:400:kworker.0 00000100:00100000:2.0:1787364885.529502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364885.529549:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364885.529568:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714083200:0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.529609:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714083328:0@lo:400:kworker.0 00000100:00100000:2.0:1787364885.529619:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364885.529660:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364885.529674:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714083072 00000100:00100000:2.0:1787364885.529686:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714083072 00000100:00100000:3.0:1787364885.529700:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787364885.529708:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714082944:0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.529743:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364885.529759:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714083200 00000100:00100000:2.0:1787364885.529764:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714083200 00000100:00100000:3.0:1787364885.529777:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714083456:0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.529828:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364885.529836:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787364885.529856:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714083072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.529871:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714083584 00000100:00100000:3.0:1787364885.529876:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714083584 00000100:00100000:3.0:1787364885.529913:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714083328 00000100:00100000:3.0:1787364885.529916:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714083328 00000100:00100000:2.0:1787364885.529932:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714083072:12345-0@lo:400:kworker.0 Request processed in 86us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364885.529941:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787364885.529944:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787364885.529954:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714083584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364885.529966:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714083456 00000100:00100000:2.0:1787364885.529971:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714083456 00000100:00100000:3.0:1787364885.530003:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714083584:12345-0@lo:400:kworker.0 Request processed in 51us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364885.530011:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787364885.530024:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787364885.530029:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714083328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.530061:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714083328:12345-0@lo:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364885.530067:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787364885.530085:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714082944 00000100:00100000:3.0:1787364885.530087:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714082944 00000100:00100000:3.0:1787364885.530114:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787364885.530122:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714082944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.530150:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714082944:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364885.530156:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787364885.530184:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787364885.530192:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714083200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.530222:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714083200:12345-0@lo:400:kworker.0 Request processed in 31us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364885.530229:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787364885.530245:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787364885.530251:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714083456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.530277:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714083456:12345-0@lo:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364885.530282:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787364885.530343:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714082944:0@lo:400:kworker.0 00000100:00100000:3.0:1787364885.530361:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714083456:0@lo:400:kworker.0 00010000:00080000:3.0:1787364885.530375:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4e680 x1874187714083328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364885.530387:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714083328:0@lo:400:kworker.0 00000100:00080000:2.0:1787364885.532915:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364885.532933:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364885.532940:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364885.533037:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714083200:0@lo:400:kworker.0 00000100:00100000:2.0:1787364885.533058:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714083072:0@lo:400:kworker.0 00010000:00080000:2.0:1787364885.533077:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4c700 x1874187714083584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364885.533088:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714083584:0@lo:400:kworker.0 00000100:00100000:2.0:1787364886.027222:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714083712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364886.027332:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364886.027482:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714083712 00000100:00100000:1.0:1787364886.027493:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714083712 00000100:00100000:1.0:1787364886.027571:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787364886.027584:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714083712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364886.027634:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364886.027695:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714083712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364886.027703:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787364886.028013:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc30000 x1874187714083712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364886.028036:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714083712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364886.039094:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714083840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364886.039219:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364886.040827:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714083840 00000100:00100000:0.0:1787364886.040854:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714083840 00000100:00100000:0.0:1787364886.040930:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787364886.040943:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714083840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787364886.040992:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364886.041094:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714083840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1874us total) trans 0 rc 0/0 00010000:00080000:2.0:1787364886.042177:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4df80 x1874187714083840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364886.042209:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787364886.042210:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714083840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364886.091353:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364887.121071:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364888.147207:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364888.345701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364888.345769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364888.345886:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688882944 00000100:00100000:1.0:1787364888.345897:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688882944 00000100:00100000:1.0:1787364888.345966:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 226 00000100:00100000:1.0:1787364888.345978:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2365:x1874187688882944:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364888.346062:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2365:x1874187688882944:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 85us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364888.346070:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 226 00000100:00100000:3.0:1787364888.350047:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688883072 00000100:00100000:3.0:1787364888.350217:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688883072 00000100:00100000:3.0:1787364888.350360:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 78 00000100:00100000:3.0:1787364888.350387:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688883072:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364888.350522:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688883072:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 139us (4753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364888.350530:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 78 00000100:00100000:1.0:1787364888.350633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364888.350754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364888.350780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364888.350839:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688883328 00000100:00100000:1.0:1787364888.350843:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688883328 00000100:00100000:1.0:1787364888.350876:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688883456 00000100:00100000:1.0:1787364888.350879:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688883456 00000100:00100000:1.0:1787364888.350906:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:1.0:1787364888.350914:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688883328:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364888.350949:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688883328:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 36us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364888.350969:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:1.0:1787364888.350984:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00100000:1.0:1787364888.350990:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688883456:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364888.351015:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688883456:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364888.351021:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00080000:2.0:1787364888.355684:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364888.355693:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364888.355697:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364888.355720:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688883200 00000100:00100000:2.0:1787364888.355730:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688883200 00000100:00100000:2.0:1787364888.355851:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 79 00000100:00100000:2.0:1787364888.355862:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688883200:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364888.356116:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688883200:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 255us (5360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364888.356124:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 79 00000100:00080000:0.0:1787364888.356207:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787364889.165122:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364890.189013:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364890.635254:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714083968:0@lo:400:kworker.0 00000100:00100000:0.0:1787364890.635347:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364890.635504:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787364890.635518:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714084096:0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.635550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364890.635586:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714084096 00000100:00100000:1.0:1787364890.635593:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714084096 00000100:00100000:1.0:1787364890.635639:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787364890.635648:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714084096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.635698:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714084096:12345-0@lo:400:kworker.0 Request processed in 52us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364890.635705:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787364890.635764:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714084096:0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.635841:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714084224:0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.635863:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364890.635890:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714084224 00000100:00100000:1.0:1787364890.635894:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714084224 00000100:00100000:1.0:1787364890.635925:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787364890.635931:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714084224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.635974:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714084224:12345-0@lo:400:kworker.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364890.635996:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787364890.636041:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714084224:0@lo:400:kworker.0 00000100:00100000:2.0:1787364890.640222:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714084352:0@lo:400:kworker.0 00000100:00100000:2.0:1787364890.640298:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364890.640432:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714083968 00000100:00100000:3.0:1787364890.640441:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714083968 00000100:00100000:3.0:1787364890.640496:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787364890.640506:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714083968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.653437:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714084352 00000100:00100000:1.0:1787364890.653454:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714084352 00000100:00100000:1.0:1787364890.653527:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787364890.653538:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714084352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.653644:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714084352:12345-0@lo:400:kworker.0 Request processed in 109us (13345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364890.653652:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787364890.653701:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc33100 x1874187714084352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364890.653716:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714084352:0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.653778:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787364890.653803:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714084480:0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.653842:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364890.653875:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714084480 00000100:00100000:1.0:1787364890.653879:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714084480 00000100:00100000:1.0:1787364890.653908:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787364890.653914:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714084480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.653949:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714084480:12345-0@lo:400:kworker.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364890.653956:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787364890.653996:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714084480:0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.654211:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787364890.654219:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714084608:0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.654246:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364890.654269:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714084608 00000100:00100000:1.0:1787364890.654273:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714084608 00000100:00100000:1.0:1787364890.654298:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787364890.654304:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714084608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364890.654339:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714084608:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364890.654345:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787364890.654370:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc33100 x1874187714084608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364890.654380:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714084608:0@lo:400:kworker.0 00000100:00100000:3.0:1787364890.661919:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714083968:12345-0@lo:400:kworker.0 Request processed in 21403us (26560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364890.661934:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1787364890.662173:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364890.662179:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787364890.662182:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364890.669959:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714083968:0@lo:400:kworker.0 00000100:00100000:2.0:1787364891.164701:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714084736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364891.164780:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364891.164962:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714084736 00000100:00100000:0.0:1787364891.164969:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714084736 00000100:00100000:0.0:1787364891.165016:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787364891.165026:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714084736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787364891.165058:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364891.165104:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714084736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364891.165111:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787364891.165132:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787364891.165141:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714084864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364891.165165:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364891.165189:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714084864 00000100:00100000:0.0:1787364891.165192:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714084864 00000100:00100000:0.0:1787364891.165212:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787364891.165218:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714084864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787364891.165236:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364891.165279:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714084864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364891.165285:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787364891.165319:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c078d4000 x1874187714084736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364891.165336:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714084736:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787364891.165368:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4df80 x1874187714084864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364891.165898:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714084864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364891.232904:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364892.234913:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364893.259410:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364893.468381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364893.468432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364893.468473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364893.468506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364893.468537:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364893.468578:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688883584 00000100:00100000:1.0:1787364893.468591:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688883584 00000100:00100000:1.0:1787364893.468660:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 228 00000100:00100000:1.0:1787364893.468686:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688883584:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364893.468854:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688883584:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 183us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364893.468863:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 228 00000100:00100000:2.0:1787364893.468869:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688883712 00000100:00100000:2.0:1787364893.468888:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688883712 00000100:00100000:2.0:1787364893.468964:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688883840 00000100:00100000:2.0:1787364893.468968:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688883840 00000100:00100000:2.0:1787364893.468999:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 83 00000100:00100000:2.0:1787364893.469011:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688883712:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364893.469108:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688883712:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 99us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364893.469134:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 83 00000100:00100000:2.0:1787364893.469154:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 84 00000100:00100000:2.0:1787364893.469161:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688883840:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364893.469188:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688883840:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 27us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364893.469194:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 84 00000100:00100000:2.0:1787364893.469261:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688883968 00000100:00100000:2.0:1787364893.469265:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688883968 00000100:00100000:2.0:1787364893.469290:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688884096 00000100:00100000:2.0:1787364893.469292:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688884096 00000100:00100000:2.0:1787364893.469307:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 50 00000100:00100000:2.0:1787364893.469312:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688883968:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364893.469338:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688883968:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 26us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364893.469344:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 50 00000100:00100000:2.0:1787364893.469353:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:2.0:1787364893.469358:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688884096:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364893.469376:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688884096:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 17us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364893.469381:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00080000:2.0:1787364893.469420:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364893.469424:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364893.469427:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787364894.282926:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364895.308915:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364895.755141:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714084992:0@lo:400:kworker.0 00000100:00100000:2.0:1787364895.755198:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714085120:0@lo:400:kworker.0 00000100:00100000:0.0:1787364895.755227:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364895.755289:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714084992 00000100:00100000:1.0:1787364895.755299:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714084992 00000100:00100000:2.0:1787364895.755328:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364895.755355:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787364895.755366:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714084992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364895.755424:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714084992:12345-0@lo:400:kworker.0 Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364895.755432:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787364895.755461:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714085120 00000100:00100000:0.0:1787364895.755467:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714085120 00000100:00100000:1.0:1787364895.755498:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714084992:0@lo:400:kworker.0 00000100:00100000:2.0:1787364895.755514:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364895.755520:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787364895.755527:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714085248:0@lo:400:kworker.0 00000100:00100000:0.0:1787364895.755532:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714085120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364895.755567:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364895.755582:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714085120:12345-0@lo:400:kworker.0 Request processed in 53us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364895.755590:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787364895.755605:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714085248 00000100:00100000:2.0:1787364895.755608:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714085120:0@lo:400:kworker.0 00000100:00100000:0.0:1787364895.755611:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714085248 00000100:00100000:0.0:1787364895.755656:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787364895.755665:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714085248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364895.755695:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714085248:12345-0@lo:400:kworker.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364895.755701:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787364895.755904:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787364895.755914:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714085632:0@lo:400:kworker.0 00000100:00080000:2.0:1787364895.756070:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364895.756095:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714085248:0@lo:400:kworker.0 00000100:00100000:3.0:1787364895.756180:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364895.756221:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714085376:0@lo:400:kworker.0 00000100:00100000:3.0:1787364895.756246:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364895.756391:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787364895.756398:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714085504:0@lo:400:kworker.0 00000100:00100000:3.0:1787364895.756422:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364895.756466:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714085504 00000100:00100000:1.0:1787364895.756472:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714085504 00000100:00080000:3.0:1787364895.756501:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364895.756524:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787364895.756534:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714085504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364895.756567:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714085632 00000100:00100000:2.0:1787364895.756573:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714085632 00000100:00100000:1.0:1787364895.756581:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714085504:12345-0@lo:400:kworker.0 Request processed in 48us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364895.756589:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787364895.756608:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714085376 00000100:00100000:2.0:1787364895.756613:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714085376 00000100:00100000:1.0:1787364895.756690:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787364895.756699:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714085632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364895.756737:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714085632:12345-0@lo:400:kworker.0 Request processed in 39us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364895.756743:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787364895.756773:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714085504:0@lo:400:kworker.0 00010000:00080000:1.0:1787364895.756845:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d401bbb80 x1874187714085632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364895.756857:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714085632:0@lo:400:kworker.0 00000100:00100000:2.0:1787364895.757045:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787364895.757054:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714085376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364895.757093:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714085376:12345-0@lo:400:kworker.0 Request processed in 41us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364895.757099:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787364895.757221:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787364895.757224:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787364895.758853:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d401bad80 x1874187714085376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364895.758873:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714085376:0@lo:400:kworker.0 00000100:00100000:1.0:1787364896.267208:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787364896.267234:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714085888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364896.267314:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364896.267522:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714085888 00000100:00100000:0.0:1787364896.267531:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714085888 00000100:00100000:0.0:1787364896.267591:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787364896.267603:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714085888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787364896.267657:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364896.267712:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714085888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364896.267739:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787364896.267808:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc33b80 x1874187714085888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364896.267829:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714085888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364896.268506:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364896.268520:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714085760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364896.268562:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364896.268662:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714085760 00000100:00100000:0.0:1787364896.268667:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714085760 00000100:00100000:0.0:1787364896.268703:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787364896.268712:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714085760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787364896.268738:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364896.268778:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714085760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364896.268805:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787364896.268835:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4df80 x1874187714085760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364896.268849:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714085760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364896.331830:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364897.375424:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364898.379283:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364898.597113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364898.597173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364898.597212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364898.597243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364898.597283:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688884608 00000100:00100000:2.0:1787364898.597296:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688884608 00000100:00100000:2.0:1787364898.597375:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:2.0:1787364898.597388:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2363:x1874187688884608:12345-192.168.204.2@tcp:9:kworker.0 00000020:00000080:2.0:1787364898.597468:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2af3d 00000100:00080000:2.0:1787364898.597480:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9b6d40f47800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787364898.597528:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787364898.597855:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688884224 00000100:00100000:1.0:1787364898.597861:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688884224 00000100:00100000:1.0:1787364898.597894:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 230 00000100:00100000:1.0:1787364898.597902:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688884224:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364898.597979:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688884224:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 78us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364898.597988:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 230 00000100:00100000:1.0:1787364898.598034:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688884480 00000100:00100000:1.0:1787364898.598037:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688884480 00000100:00100000:1.0:1787364898.598069:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688884352 00000100:00100000:1.0:1787364898.598072:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688884352 00000100:00100000:1.0:1787364898.598092:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 88 00000100:00100000:1.0:1787364898.598098:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688884480:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364898.598128:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688884480:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 31us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364898.598147:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 88 00000100:00100000:1.0:1787364898.598161:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 89 00000100:00100000:1.0:1787364898.598167:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688884352:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364898.598193:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688884352:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 26us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364898.598200:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 89 00000100:00100000:1.0:1787364898.598315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364898.598427:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688884736 00000100:00100000:1.0:1787364898.598432:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688884736 00000100:00100000:1.0:1787364898.598462:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:1.0:1787364898.598468:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2363:x1874187688884736:12345-192.168.204.2@tcp:9:kworker.0 00000020:00000080:1.0:1787364898.598485:0:8229:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2af44 00000100:00080000:1.0:1787364898.598493:0:8229:0:(import.c:65:import_set_state_nolock()) ffff9b6d40f40000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787364898.598528:0:8229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787364898.598917:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+2:2363:x1874187688884736:12345-192.168.204.2@tcp:9:kworker.0 Request processed in 446us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364898.598926:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 15 00010000:00010000:1.0:1787364898.598951:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787364898.599017:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364898.599023:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787364898.599026:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787364898.599963:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364898.600598:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+2:2363:x1874187688884608:12345-192.168.204.2@tcp:9:kworker.0 Request processed in 3192us (3333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364898.600612:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00010000:00010000:1.0:1787364899.402990:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364900.428828:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787364900.496430:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41d9d144-3b1e-4bea-b859-eec032afe3d5 00000020:00000080:1.0:1787364900.496440:0:6733:0:(genops.c:885:class_export_put()) final put ffff9b6d40f46000/41d9d144-3b1e-4bea-b859-eec032afe3d5 00000020:00000080:0.0:1787364900.496521:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d40f46000/41d9d144-3b1e-4bea-b859-eec032afe3d5 for lustre-OST0000 00000020:00000080:0.0:1787364900.496702:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d40f47800 for lustre-OST0000 00000100:00100000:2.0:1787364900.875152:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714086144:0@lo:400:kworker.0 00000100:00100000:2.0:1787364900.875226:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364900.875277:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714086656:0@lo:400:kworker.0 00000100:00100000:2.0:1787364900.875304:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364900.875338:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364900.875346:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714086272:0@lo:400:kworker.0 00000100:00100000:2.0:1787364900.875370:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364900.875451:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714086400:0@lo:400:kworker.0 00000100:00100000:3.0:1787364900.875484:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364900.875514:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787364900.875520:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714086016:0@lo:400:kworker.0 00000100:00100000:3.0:1787364900.875560:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364900.875586:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714086528:0@lo:400:kworker.0 00000100:00100000:3.0:1787364900.875606:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364900.875753:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714086016 00000100:00100000:0.0:1787364900.875761:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714086016 00000100:00100000:0.0:1787364900.875893:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787364900.875904:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714086016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364900.875968:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714086016:12345-0@lo:400:kworker.0 Request processed in 66us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364900.875985:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787364900.876045:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714086016:0@lo:400:kworker.0 00000100:00100000:1.0:1787364900.877684:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714086144 00000100:00100000:1.0:1787364900.877696:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714086144 00000100:00100000:1.0:1787364900.877762:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714086272 00000100:00100000:1.0:1787364900.877765:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714086272 00000100:00080000:2.0:1787364900.877898:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364900.878921:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714086528 00000100:00100000:1.0:1787364900.878930:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714086528 00000100:00100000:1.0:1787364900.878964:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787364900.878974:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714086144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364900.879084:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714086144:12345-0@lo:400:kworker.0 Request processed in 112us (3859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364900.879091:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787364900.879107:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787364900.879114:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714086272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364900.879142:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714086272:12345-0@lo:400:kworker.0 Request processed in 30us (3773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364900.879148:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787364900.879157:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787364900.879163:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714086528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364900.879195:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714086528:12345-0@lo:400:kworker.0 Request processed in 32us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364900.879200:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787364900.879230:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714086656 00000100:00100000:1.0:1787364900.879234:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714086656 00000100:00100000:1.0:1787364900.879262:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714086400 00000100:00100000:1.0:1787364900.879265:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714086400 00000100:00100000:1.0:1787364900.879285:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787364900.879292:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714086656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364900.879323:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714086656:12345-0@lo:400:kworker.0 Request processed in 32us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364900.879339:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787364900.879350:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787364900.879355:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714086400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364900.879384:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714086400:12345-0@lo:400:kworker.0 Request processed in 28us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364900.879390:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787364900.879466:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714086272:0@lo:400:kworker.0 00000100:00100000:1.0:1787364900.879476:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714086144:0@lo:400:kworker.0 00010000:00080000:1.0:1787364900.879489:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d04fd3800 x1874187714086656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364900.879498:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714086656:0@lo:400:kworker.0 00000100:00080000:2.0:1787364900.879602:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364900.879606:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364900.879608:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364900.880083:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714086528:0@lo:400:kworker.0 00010000:00080000:1.0:1787364900.880098:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d33dfc700 x1874187714086400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364900.880107:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714086400:0@lo:400:kworker.0 00000100:00100000:0.0:1787364901.387022:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714086784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364901.387102:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364901.387184:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714086784 00000100:00100000:0.0:1787364901.387191:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714086784 00000100:00100000:0.0:1787364901.387235:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787364901.387296:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714086912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364901.387301:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714086784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364901.387334:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787364901.387343:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364901.387384:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714086912 00000100:00100000:1.0:1787364901.387388:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714086912 00000100:00100000:0.0:1787364901.387400:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714086784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364901.387410:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787364901.393365:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787364901.393397:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714086912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364901.393447:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364901.393753:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714086912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 373us (6418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364901.393762:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787364901.393841:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc30a80 x1874187714086912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364901.393865:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714086912:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787364901.394032:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4df80 x1874187714086784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364901.394048:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714086784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364901.457166:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787364901.514079:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41d9d144-3b1e-4bea-b859-eec032afe3d5 00000020:00000080:3.0:1787364901.514090:0:7661:0:(genops.c:885:class_export_put()) final put ffff9b6d40f44800/41d9d144-3b1e-4bea-b859-eec032afe3d5 00000020:00000080:2.0:1787364901.515887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d40f44800/41d9d144-3b1e-4bea-b859-eec032afe3d5 for lustre-OST0001 00000020:00000080:2.0:1787364901.515950:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d40f40000 for lustre-OST0001 00010000:00010000:3.0:1787364902.476025:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364903.499118:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364903.726093:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364903.726584:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688884864 00000100:00100000:3.0:1787364903.726595:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688884864 00000100:00100000:3.0:1787364903.726664:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 232 00000100:00100000:3.0:1787364903.726675:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688884864:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364903.726758:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688884864:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 85us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364903.726766:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 232 00000100:00100000:2.0:1787364903.727959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364903.728389:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688884992 00000100:00100000:3.0:1787364903.728409:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688884992 00000100:00100000:3.0:1787364903.728469:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 93 00000100:00100000:3.0:1787364903.728479:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688884992:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364903.728555:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688884992:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 77us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364903.728563:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 93 00000100:00080000:2.0:1787364903.729144:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364903.729554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364903.729611:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688885120 00000100:00100000:1.0:1787364903.729617:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688885120 00000100:00100000:1.0:1787364903.729680:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 94 00000100:00100000:1.0:1787364903.729690:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688885120:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364903.729743:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688885120:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364903.729751:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 94 00000100:00080000:2.0:1787364903.730159:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787364904.526000:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364905.547698:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364905.998854:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714087424:0@lo:400:kworker.0 00000100:00100000:3.0:1787364905.998926:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364905.999012:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787364905.999019:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714087040:0@lo:400:kworker.0 00000100:00100000:3.0:1787364905.999050:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364905.999076:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714087552:0@lo:400:kworker.0 00000100:00100000:3.0:1787364905.999100:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364905.999130:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714087040 00000100:00100000:3.0:1787364905.999137:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714087040 00000100:00100000:3.0:1787364905.999198:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787364905.999208:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714087040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364905.999626:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714087040:12345-0@lo:400:kworker.0 Request processed in 419us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364905.999635:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787364905.999668:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714087552 00000100:00100000:3.0:1787364905.999672:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714087552 00000100:00100000:3.0:1787364905.999704:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787364905.999711:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714087552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364905.999741:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714087552:12345-0@lo:400:kworker.0 Request processed in 32us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364905.999764:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787364905.999961:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714087040:0@lo:400:kworker.0 00000100:00100000:3.0:1787364906.000039:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714087552:0@lo:400:kworker.0 00000100:00100000:2.0:1787364906.001008:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714087424 00000100:00100000:2.0:1787364906.001018:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714087424 00000100:00100000:2.0:1787364906.001081:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787364906.001091:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714087424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364906.001175:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714087424:12345-0@lo:400:kworker.0 Request processed in 86us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364906.001183:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787364906.001207:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364906.001211:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364906.001951:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787364906.002012:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364906.002055:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714087680:0@lo:400:kworker.0 00000100:00100000:0.0:1787364906.002081:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364906.002114:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364906.002121:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714087296:0@lo:400:kworker.0 00000100:00100000:0.0:1787364906.002143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364906.002179:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714087168 00000100:00100000:0.0:1787364906.002194:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714087168 00000100:00100000:0.0:1787364906.002225:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714087296 00000100:00100000:0.0:1787364906.002228:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714087296 00000100:00100000:1.0:1787364906.002837:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787364906.002851:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714087168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364906.002914:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714087168:12345-0@lo:400:kworker.0 Request processed in 68us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364906.002922:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787364906.002977:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714087168:0@lo:400:kworker.0 00000100:00100000:2.0:1787364906.003149:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714087680 00000100:00100000:2.0:1787364906.003154:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714087680 00010000:00080000:3.0:1787364906.003257:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34452d80 x1874187714087424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364906.003270:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714087424:0@lo:400:kworker.0 00000100:00100000:0.0:1787364906.005273:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787364906.005289:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714087296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364906.005374:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714087296:12345-0@lo:400:kworker.0 Request processed in 90us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364906.005381:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787364906.005695:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714087296:0@lo:400:kworker.0 00000100:00100000:2.0:1787364906.006024:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787364906.006033:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714087680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364906.006079:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714087680:12345-0@lo:400:kworker.0 Request processed in 48us (3997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364906.006085:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787364906.006266:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d34243100 x1874187714087680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364906.006278:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714087680:0@lo:400:kworker.0 00000100:00080000:3.0:1787364906.013127:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787364906.013139:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364906.507451:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714087808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364906.507532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364906.507636:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714087808 00000100:00100000:0.0:1787364906.507643:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714087808 00000100:00100000:0.0:1787364906.507693:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787364906.507706:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714087808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787364906.507742:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364906.507809:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714087808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364906.507817:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787364906.507866:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fd4ca80 x1874187714087808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364906.507892:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714087808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364906.514892:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714087936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364906.514982:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364906.515056:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714087936 00000100:00100000:1.0:1787364906.515065:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714087936 00000100:00100000:1.0:1787364906.515113:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787364906.515122:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714087936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364906.515161:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364906.515208:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714087936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364906.515216:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787364906.515255:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fc30a80 x1874187714087936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364906.515276:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714087936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787364906.571273:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787364906.991750:0:11037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787364907.595195:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364908.619868:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364908.832094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364908.832133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364908.832173:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364908.832211:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688885504 00000100:00100000:1.0:1787364908.832222:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688885504 00000100:00100000:1.0:1787364908.832496:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688885376 00000100:00100000:1.0:1787364908.832501:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688885376 00000100:00100000:1.0:1787364908.832530:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 98 00000100:00100000:1.0:1787364908.832541:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688885504:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364908.832632:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688885504:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 93us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364908.832640:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 98 00000100:00100000:1.0:1787364908.832660:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 99 00000100:00100000:1.0:1787364908.832676:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688885376:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364908.832705:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688885376:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 31us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364908.832712:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 99 00000100:00080000:1.0:1787364908.832730:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364908.835168:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688885248 00000100:00100000:0.0:1787364908.835195:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688885248 00000100:00100000:0.0:1787364908.835264:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 234 00000100:00100000:0.0:1787364908.835276:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688885248:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364908.835377:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688885248:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 103us (3299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364908.835385:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 234 00010000:00010000:1.0:1787364909.647714:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364910.668691:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364911.115560:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714088192:0@lo:400:kworker.0 00000100:00100000:2.0:1787364911.115595:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714088064:0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.115673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364911.115676:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714088448:0@lo:400:kworker.0 00000100:00100000:1.0:1787364911.115741:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714088192 00000100:00100000:1.0:1787364911.115753:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714088192 00000100:00100000:2.0:1787364911.115805:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364911.115860:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787364911.115872:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714088192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364911.124165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364911.125419:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714088064 00000100:00100000:0.0:1787364911.125430:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714088704:0@lo:400:kworker.0 00000100:00100000:3.0:1787364911.125434:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714088064 00000100:00100000:0.0:1787364911.125498:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364911.125533:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364911.125541:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714088320:0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.125572:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364911.125628:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787364911.125642:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714088064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.125682:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714088448 00000100:00100000:0.0:1787364911.125688:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714088448 00000100:00100000:3.0:1787364911.125717:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714088064:12345-0@lo:400:kworker.0 Request processed in 78us (9934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364911.125726:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787364911.125737:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714088704 00000100:00100000:0.0:1787364911.125742:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714088704 00000100:00100000:0.0:1787364911.125771:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787364911.125779:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714088448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.125849:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714088448:12345-0@lo:400:kworker.0 Request processed in 71us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.125856:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787364911.125870:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787364911.125876:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714088704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.125911:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714088704:12345-0@lo:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.125938:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787364911.125960:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714088320 00000100:00100000:0.0:1787364911.125963:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714088320 00000100:00100000:0.0:1787364911.125994:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787364911.126001:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714088320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.126034:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714088320:12345-0@lo:400:kworker.0 Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.126041:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1787364911.126209:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787364911.126216:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787364911.126218:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787364911.126278:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714088064:0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.126282:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714088320:0@lo:400:kworker.0 00000100:00100000:2.0:1787364911.126293:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714088576:0@lo:400:kworker.0 00010000:00080000:0.0:1787364911.126302:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d342aea00 x1874187714088704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364911.126314:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714088704:0@lo:400:kworker.0 00000100:00100000:2.0:1787364911.126329:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364911.126618:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714088576 00000100:00100000:0.0:1787364911.126623:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714088576 00010000:00080000:3.0:1787364911.126660:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fddb100 x1874187714088448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364911.126673:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714088448:0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.126705:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787364911.126714:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714088576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364911.126765:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714088576:12345-0@lo:400:kworker.0 Request processed in 52us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.126773:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1787364911.126937:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364911.127026:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714088192:12345-0@lo:400:kworker.0 Request processed in 11154us (11351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364911.127036:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787364911.127160:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714088192:0@lo:400:kworker.0 00000100:00100000:3.0:1787364911.128284:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714088576:0@lo:400:kworker.0 00000020:00000080:2.0:1787364911.335403:0:11185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd9adc8a0 20000000:00000080:2.0:1787364911.335424:0:11185:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6c061f4400 uarg=0000000000000000 20000000:01000000:2.0:1787364911.335467:0:11185:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787364911.335475:0:11185:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787364911.335480:0:11185:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787364911.340236:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787364911.341059:0:11185:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787364911.351567:0:11185:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787364911.351602:0:11185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.351638:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.351648:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.351655:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.351661:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.351697:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.351705:0:11185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.351752:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.351769:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 12 pid: 5850 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.352008:0:11185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714088832:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364911.352131:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.352140:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 18 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.352149:0:11185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714088960:0@lo:104: 00000100:00100000:1.0:1787364911.352201:0:11185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787364911.352261:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.352269:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 18 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364911.352599:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714088960 00000100:00100000:0.0:1787364911.352608:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714088960 00000100:00100000:0.0:1787364911.352684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787364911.352703:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11185:x1874187714088960:12345-0@lo:104: 00010000:00010000:0.0:1787364911.352716:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.352764:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787364911.352769:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11185:x1874187714088960:12345-0@lo:104: Request processed in 70us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.352776:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787364911.352822:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364911.352829:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.352836:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364911.352840:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.352849:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364911.352856:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364911.352861:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787364911.352884:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.352891:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364911.352909:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.352927:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2af13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af1a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.352942:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364911.352944:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364911.352945:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364911.352959:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714089216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364911.352991:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364911.353027:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714089216 00000100:00100000:0.0:1787364911.353030:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714089216 00010000:00010000:0.0:1787364911.353046:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 19 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364911.353068:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787364911.353074:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714089216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787364911.353083:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364911.353088:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 19 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.353134:0:11185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714089088:0@lo:104: 00000100:00100000:1.0:1787364911.353168:0:11185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787364911.354812:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 19 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.354841:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364911.354909:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714089216:12345-0@lo:103:ldlm_bl.0 Request processed in 1834us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.354920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787364911.355006:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714089216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364911.355049:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714089088 00000100:00100000:0.0:1787364911.355055:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714089088 00000100:00100000:0.0:1787364911.355084:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787364911.355091:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11185:x1874187714089088:12345-0@lo:104: 00010000:00010000:0.0:1787364911.355103:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.355142:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787364911.355147:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11185:x1874187714089088:12345-0@lo:104: Request processed in 57us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.355153:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787364911.355166:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364911.355171:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.355178:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0c00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364911.355182:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.355190:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364911.355198:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364911.355203:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787364911.355231:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.355237:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364911.355260:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.355267:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2af05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af0c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.355281:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364911.355282:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364911.355284:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364911.355295:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714089344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364911.355451:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364911.355504:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714089344 00000100:00100000:0.0:1787364911.355509:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714089344 00010000:00010000:0.0:1787364911.355527:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 19 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364911.355550:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787364911.355557:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714089344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787364911.355570:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364911.355575:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 19 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.355584:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 19 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.355598:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364911.355733:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714089344:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.355740:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787364911.355778:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714089344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787364911.356206:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.356219:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 18 pid: 5851 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.356231:0:11185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714089472:0@lo:104: 00000100:00100000:1.0:1787364911.356271:0:11185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787364911.356319:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.356329:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 12 pid: 5851 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.356349:0:11185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714089600:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364911.356590:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714089472 00000100:00100000:0.0:1787364911.356596:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714089472 00000100:00100000:0.0:1787364911.356626:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787364911.356634:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11185:x1874187714089472:12345-0@lo:104: 00010000:00010000:0.0:1787364911.356645:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.356685:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787364911.356690:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11185:x1874187714089472:12345-0@lo:104: Request processed in 57us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.356697:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787364911.356715:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364911.356720:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.356727:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787364911.356731:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.356739:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787364911.356745:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364911.356751:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787364911.356775:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.356781:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787364911.356827:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.356834:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5200/0xcfc9272e5fc2aef7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2aefe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.356851:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364911.356853:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364911.356855:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364911.356867:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714089728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787364911.356897:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364911.356926:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714089728 00000100:00100000:0.0:1787364911.356930:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714089728 00010000:00010000:0.0:1787364911.356951:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 19 pid: 5851 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364911.356970:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787364911.356976:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714089728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787364911.356988:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364911.356992:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 19 pid: 5851 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.357000:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 19 pid: 5851 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364911.357012:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364911.357037:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714089728:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.357042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787364911.357075:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714089728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787364911.357079:0:11185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd5600 going to sleep for 11 seconds 00010000:00010000:1.0:1787364911.357094:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2af1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2af13 expref: 18 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.357105:0:11185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714088960:0@lo:104: 00010000:00010000:1.0:1787364911.357115:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2af0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2af05 expref: 17 pid: 5850 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.357123:0:11185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714089088:0@lo:104: 00010000:00010000:1.0:1787364911.357131:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e35200/0xcfc9272e5fc2aefe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2aef7 expref: 16 pid: 5851 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.357139:0:11185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714089472:0@lo:104: 00000100:00100000:0.0:1787364911.359691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364911.359897:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688885632 00000100:00100000:2.0:1787364911.359906:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688885632 00010000:00010000:2.0:1787364911.359942:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 13 pid: 5850 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364911.359997:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 28 00000100:00100000:2.0:1787364911.360007:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2366:x1874187688885632:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364911.360020:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364911.360025:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 13 pid: 5850 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.360037:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 13 pid: 5850 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.360058:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364911.360110:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2366:x1874187688885632:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 105us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364911.360118:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 28 00010000:00010000:1.0:1787364911.360306:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e35000/0xcfc9272e5fc2af2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dac4 expref: 12 pid: 5850 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364911.360319:0:11185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714088832:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364911.364663:0:11185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1874187714089600:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364911.364709:0:11185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364911.369711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364911.370197:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688885760 00000100:00100000:2.0:1787364911.370209:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688885760 00010000:00010000:2.0:1787364911.370250:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 12 pid: 5851 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364911.370293:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:2.0:1787364911.370305:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+12:2367:x1874187688885760:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364911.370331:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364911.370347:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 12 pid: 5851 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370376:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 12 pid: 5851 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370512:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28335c00/0xcfc9272e5fc2aef0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da8c expref: 12 pid: 5851 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370544:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370553:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370571:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370577:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370584:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370591:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370598:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364911.370602:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370621:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370656:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364911.370674:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364911.370839:0:11185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.370848:0:11185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364911.370854:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0a00/0xcfc9272e5fc2af4b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364911.371802:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+11:2367:x1874187688885760:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 1476us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364911.371813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:1.0:1787364911.627105:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787364911.627134:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714089856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364911.627214:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364911.627383:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714089856 00000100:00100000:0.0:1787364911.627394:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714089856 00000100:00100000:0.0:1787364911.627461:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787364911.627471:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714089856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787364911.627511:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364911.627558:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714089856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364911.627565:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787364911.627829:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364911.627841:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714089984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364911.627878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364911.627992:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714089984 00000100:00100000:3.0:1787364911.627998:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714089984 00000100:00100000:3.0:1787364911.628025:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787364911.628032:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714089984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364911.628056:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364911.628097:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714089984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364911.628103:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787364911.628207:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fddad80 x1874187714089984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364911.628227:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714089984:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787364911.628387:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fdd8e00 x1874187714089856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364911.628626:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714089856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787364911.691270:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364912.474398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364912.474505:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688885888 00000100:00100000:0.0:1787364912.474516:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688885888 00000100:00100000:0.0:1787364912.474573:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 236 00000100:00100000:0.0:1787364912.474593:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+11:5608:x1874187688885888:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787364912.474612:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364912.474808:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67daee expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364912.474840:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364912.474852:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364912.474969:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5200, rc 0) 00000100:00100000:0.0:1787364912.475070:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688885888:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 Request processed in 488us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364912.475087:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 236 00000100:00100000:1.0:1787364912.483050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364912.483170:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688886016 00000100:00100000:3.0:1787364912.483183:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688886016 00000100:00100000:3.0:1787364912.483309:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 237 00000100:00100000:3.0:1787364912.483331:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688886016:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364912.483660:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688886016:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 Request processed in 341us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364912.483669:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 237 00000100:00100000:1.0:1787364912.488772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364912.488886:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688886144 00000100:00100000:2.0:1787364912.488896:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688886144 00000100:00100000:2.0:1787364912.488953:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 238 00000100:00100000:2.0:1787364912.488964:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688886144:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364912.489195:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688886144:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 Request processed in 232us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364912.489203:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 238 00000100:00100000:1.0:1787364912.500991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364912.501053:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688886272 00000100:00100000:3.0:1787364912.501064:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688886272 00000100:00100000:3.0:1787364912.501133:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 239 00000100:00100000:3.0:1787364912.501144:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688886272:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787364912.501163:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364912.501183:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67daf5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.501232:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.501245:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.501255:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c8000, rc 0) 00000100:00100000:3.0:1787364912.502145:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688886272:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 Request processed in 997us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364912.502155:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 239 00000100:00100000:3.0:1787364912.515581:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364912.515879:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688886400 00000100:00100000:1.0:1787364912.515892:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688886400 00000100:00100000:1.0:1787364912.515952:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 240 00000100:00100000:1.0:1787364912.515964:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688886400:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364912.516287:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688886400:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 Request processed in 324us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364912.516295:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 240 00000100:00100000:1.0:1787364912.525138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364912.525242:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688886528 00000100:00100000:3.0:1787364912.525254:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688886528 00000100:00100000:3.0:1787364912.525376:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 241 00000100:00100000:3.0:1787364912.525387:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688886528:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364912.525684:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688886528:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 Request processed in 298us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364912.525692:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 241 00010000:00010000:1.0:1787364912.714906:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787364912.720855:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787364912.720864:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6c06f84800 from 7 10000000:01000000:2.0:1787364912.720869:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787364912.720923:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364912.720935:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364912.720948:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364912.720990:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787364912.721064:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364912.721127:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364912.721400:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714090112 00000100:00100000:1.0:1787364912.721409:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714090112 00000100:00100000:1.0:1787364912.721469:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787364912.721478:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714090112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364912.721491:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364912.721504:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2af60 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364912.721526:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364912.721536:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364912.721545:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0c00, rc 0) 00000100:00100000:1.0:1787364912.721584:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714090112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364912.721591:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787364912.722365:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364912.722382:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364912.722391:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364912.722458:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364912.722496:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364912.722573:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364912.724451:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714090240 00000100:00100000:1.0:1787364912.724464:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714090240 00000100:00100000:1.0:1787364912.724516:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787364912.724528:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714090240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364912.725248:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714090240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 720us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364912.725258:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787364912.727782:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364912.727867:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364912.727937:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364912.727990:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364912.728332:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714090368 00000100:00100000:3.0:1787364912.728339:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714090368 00000100:00100000:3.0:1787364912.728393:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787364912.728403:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714090368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364912.728599:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714090368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364912.728606:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787364912.728757:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787364912.732060:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787364912.733014:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787364912.733042:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787364912.733052:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.733064:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364912.733074:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787364912.733077:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d055cd000 from 7 10000000:01000000:3.0:1787364912.733080:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787364912.733114:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.733121:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.733132:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364912.733157:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787364912.733227:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364912.733267:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06268c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787364912.733286:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714090496 00000100:00100000:3.0:1787364912.734395:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714090496 00000100:00100000:3.0:1787364912.734569:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787364912.734580:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714090496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787364912.734596:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364912.734612:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2af6e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.734653:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.734664:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.734673:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c9c00, rc 0) 00000100:00100000:3.0:1787364912.734738:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714090496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364912.734745:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787364912.734922:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364912.734937:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364912.734947:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364912.735022:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364912.735055:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364912.744998:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714090624 00000100:00100000:0.0:1787364912.745015:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714090624 00000100:00100000:0.0:1787364912.745068:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787364912.745082:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714090624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364912.746140:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364912.746871:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714090624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1788us (11811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364912.746881:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787364912.746887:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364912.746938:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787364912.746984:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364912.747018:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d062686c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364912.747076:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714090752 00000100:00100000:0.0:1787364912.747082:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714090752 00000100:00100000:0.0:1787364912.747156:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787364912.747164:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714090752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364912.747334:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714090752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364912.747341:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787364912.747408:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787364912.748108:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787364912.748158:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787364912.748175:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787364912.748184:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.748195:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787364912.748205:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787364912.748213:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d20269000 from 7 10000000:01000000:3.0:1787364912.748216:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787364912.748241:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.748249:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364912.748258:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364912.748274:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787364912.748309:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364912.750920:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06268540 going to sleep for 11 seconds 00000100:00100000:2.0:1787364912.751206:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714090880 00000100:00100000:2.0:1787364912.751216:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714090880 00000100:00100000:2.0:1787364912.751274:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787364912.751284:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714090880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364912.751436:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364912.751457:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2af7c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364912.751490:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364912.751502:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364912.751512:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35400, rc 0) 00000100:00100000:2.0:1787364912.751591:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714090880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 307us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364912.751598:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787364912.751987:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714090880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787364912.752005:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364912.752015:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364912.752089:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714091008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364912.752130:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364912.752193:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787364912.752286:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714091008 00000100:00100000:1.0:1787364912.752291:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714091008 00000100:00100000:1.0:1787364912.752375:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787364912.752384:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714091008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364912.752634:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714091008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364912.752641:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787364912.752897:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714091008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364912.752928:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714091136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364912.752964:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364912.752982:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364912.753031:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714091136 00000100:00100000:2.0:1787364912.753035:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714091136 00000100:00100000:2.0:1787364912.753063:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787364912.753070:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714091136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364912.753201:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714091136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364912.753214:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787364912.753280:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714091136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787364912.754631:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787364912.754775:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787364912.754813:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787364912.754824:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364912.754837:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364913.747088:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364913.951958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364913.952030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364913.952076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364913.952114:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688886656 00000100:00100000:1.0:1787364913.952114:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688886912 00000100:00100000:3.0:1787364913.952123:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688886656 00000100:00100000:1.0:1787364913.952137:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688886912 00000100:00100000:3.0:1787364913.952177:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 251 00000100:00100000:3.0:1787364913.952187:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688886656:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364913.952206:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688886784 00000100:00100000:1.0:1787364913.952209:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688886784 00000100:00100000:1.0:1787364913.952263:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 103 00000100:00100000:3.0:1787364913.952264:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688886656:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364913.952283:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688886912:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364913.952285:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 251 00000100:00100000:1.0:1787364913.952336:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688886912:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364913.952342:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 103 00000100:00100000:1.0:1787364913.952356:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 104 00000100:00100000:1.0:1787364913.952362:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688886784:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364913.952398:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688886784:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364913.952405:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 104 00000100:00080000:1.0:1787364913.952458:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787364914.763072:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364915.788360:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787364916.017415:0:11382:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787364916.235217:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714091392:0@lo:400:kworker.0 00000100:00100000:2.0:1787364916.235421:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714091264:0@lo:400:kworker.0 00000100:00100000:2.0:1787364916.235493:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364916.235555:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714091776:0@lo:400:kworker.0 00000100:00100000:2.0:1787364916.235582:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364916.235762:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364916.235886:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714091904:0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.235992:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364916.236026:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714091520:0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.236049:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364916.236067:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364916.236073:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714091648:0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.236092:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364916.236125:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714091264 00000100:00100000:1.0:1787364916.236132:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714091264 00000100:00100000:1.0:1787364916.236409:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787364916.236419:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714091264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.236474:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714091264:12345-0@lo:400:kworker.0 Request processed in 57us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364916.236481:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787364916.236686:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714091776 00000100:00100000:2.0:1787364916.236691:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714091776 00000100:00100000:2.0:1787364916.236726:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714091392 00000100:00100000:2.0:1787364916.236729:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714091392 00000100:00100000:2.0:1787364916.236741:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714091520 00000100:00100000:2.0:1787364916.236743:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714091520 00000100:00100000:2.0:1787364916.236759:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787364916.236766:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714091776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364916.240468:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714091776:12345-0@lo:400:kworker.0 Request processed in 3692us (4874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364916.240483:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787364916.240684:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787364916.240700:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714091392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.240770:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714091392:12345-0@lo:400:kworker.0 Request processed in 77us (5007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364916.240914:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787364916.240931:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787364916.240939:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714091520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.240983:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714091520:12345-0@lo:400:kworker.0 Request processed in 45us (4932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364916.240989:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787364916.241010:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714091904 00000100:00100000:1.0:1787364916.241017:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714091904 00000100:00100000:1.0:1787364916.241057:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714091648 00000100:00100000:1.0:1787364916.241061:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714091648 00000100:00100000:1.0:1787364916.241084:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787364916.241090:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714091904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.241121:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714091904:12345-0@lo:400:kworker.0 Request processed in 32us (5129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364916.241126:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787364916.241137:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787364916.241142:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714091648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.241708:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714091648:12345-0@lo:400:kworker.0 Request processed in 564us (5613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364916.241717:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787364916.242411:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d342aed80 x1874187714091648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364916.242427:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714091648:0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.242444:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714091520:0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.242488:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714091264:0@lo:400:kworker.0 00000100:00100000:1.0:1787364916.242508:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714091776:0@lo:400:kworker.0 00000100:00080000:2.0:1787364916.243432:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364916.243438:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364916.243447:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364916.244049:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714091392:0@lo:400:kworker.0 00010000:00080000:1.0:1787364916.244069:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d342afb80 x1874187714091904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364916.244080:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714091904:0@lo:400:kworker.0 00000100:00100000:2.0:1787364916.747806:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714092032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364916.747883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364916.747958:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364916.747966:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fdda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714092160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364916.747990:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364916.748121:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714092032 00000100:00100000:3.0:1787364916.748129:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714092032 00000100:00100000:3.0:1787364916.748186:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714092160 00000100:00100000:3.0:1787364916.748190:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714092160 00000100:00100000:3.0:1787364916.748209:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787364916.748218:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714092032:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364916.748322:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787364916.748331:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714092160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364916.748361:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364916.748406:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714092160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364916.748413:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787364916.748452:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fdda680 x1874187714092160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364916.748470:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fdda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714092160:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364916.748614:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364916.748659:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714092032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 441us (775us total) trans 0 rc 0/0 00010000:00080000:2.0:1787364916.748757:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fddb100 x1874187714092032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364916.748771:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714092032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364916.748892:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1787364916.818275:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364917.834986:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364918.863779:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364919.086534:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364919.090342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364919.090386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364919.090415:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688887296 00000100:00100000:1.0:1787364919.090424:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688887296 00000100:00100000:1.0:1787364919.090481:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688887168 00000100:00100000:1.0:1787364919.090484:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688887168 00000100:00100000:1.0:1787364919.090507:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 108 00000100:00100000:1.0:1787364919.090516:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688887296:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364919.090589:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688887296:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364919.090596:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 108 00000100:00100000:1.0:1787364919.090612:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 109 00000100:00100000:1.0:1787364919.090619:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688887168:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364919.090645:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688887168:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364919.090651:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 109 00000100:00080000:1.0:1787364919.090667:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364919.093885:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688887040 00000100:00100000:2.0:1787364919.093898:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688887040 00000100:00100000:1.0:1787364919.095768:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 253 00000100:00100000:1.0:1787364919.095780:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2366:x1874187688887040:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364919.095902:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2366:x1874187688887040:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 125us (9377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364919.095910:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 253 00010000:00010000:1.0:1787364919.882994:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364920.913485:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787364920.967655:0:11483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:15:18 (1787364918) === 00000100:00100000:2.0:1787364921.355599:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714092672:0@lo:400:kworker.0 00000100:00100000:2.0:1787364921.355667:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364921.355733:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787364921.355752:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714092544:0@lo:400:kworker.0 00000100:00100000:2.0:1787364921.355818:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364921.355961:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714092288:0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.355996:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364921.356030:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714092800:0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356052:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364921.356072:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787364921.356077:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714092416:0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356097:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364921.356115:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714092928:0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356158:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364921.356188:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714092672 00000100:00100000:1.0:1787364921.356195:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714092672 00000100:00100000:1.0:1787364921.356242:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714092928 00000100:00100000:1.0:1787364921.356245:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714092928 00000100:00100000:1.0:1787364921.356268:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787364921.356277:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714092672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356330:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714092672:12345-0@lo:400:kworker.0 Request processed in 54us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.356338:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787364921.356353:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787364921.356359:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714092928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356440:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714092928:12345-0@lo:400:kworker.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.356447:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787364921.356478:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714092544 00000100:00100000:1.0:1787364921.356481:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714092544 00000100:00100000:1.0:1787364921.356507:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714092800 00000100:00100000:1.0:1787364921.356509:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714092800 00000100:00100000:1.0:1787364921.356520:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714092416 00000100:00100000:1.0:1787364921.356522:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714092416 00000100:00100000:1.0:1787364921.356534:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787364921.356541:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714092544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356571:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714092544:12345-0@lo:400:kworker.0 Request processed in 32us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.356578:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787364921.356589:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787364921.356594:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714092800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356620:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714092800:12345-0@lo:400:kworker.0 Request processed in 26us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.356625:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787364921.356635:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787364921.356641:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714092416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356667:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714092416:12345-0@lo:400:kworker.0 Request processed in 26us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.356672:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1787364921.356698:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787364921.356702:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364921.356704:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364921.356746:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714092416:0@lo:400:kworker.0 00010000:00080000:1.0:1787364921.356760:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d07d2c380 x1874187714092928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364921.356770:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714092928:0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356780:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714092800:0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.356840:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714092544:0@lo:400:kworker.0 00010000:00080000:1.0:1787364921.356852:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d07d2fb80 x1874187714092672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364921.356861:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714092672:0@lo:400:kworker.0 00000100:00100000:2.0:1787364921.357454:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714092288 00000100:00100000:2.0:1787364921.357470:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714092288 00000100:00100000:2.0:1787364921.357514:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787364921.357522:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714092288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364921.357581:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714092288:12345-0@lo:400:kworker.0 Request processed in 60us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364921.357587:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787364921.357669:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714092288:0@lo:400:kworker.0 00000100:00100000:1.0:1787364921.451976:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.452091:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688887424 00000100:00100000:2.0:1787364921.452101:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688887424 00000100:00100000:2.0:1787364921.452190:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:2.0:1787364921.452201:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688887424:12345-192.168.204.2@tcp:41:mkdir.0 00000004:00000024:2.0:1787364921.452258:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787364921.452363:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688887424:12345-192.168.204.2@tcp:41:mkdir.0 Request processed in 164us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364921.452370:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00080000:1.0:1787364921.452945:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364921.468308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.470119:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688887552 00000100:00100000:2.0:1787364921.470131:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688887552 00000100:00100000:2.0:1787364921.470199:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:2.0:1787364921.470209:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6b97b2b3-6991-434b-88a0-aee779536483+6:9695:x1874187688887552:12345-192.168.204.2@tcp:700:mkdir.0 00000100:00100000:2.0:1787364921.470303:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6b97b2b3-6991-434b-88a0-aee779536483+6:9695:x1874187688887552:12345-192.168.204.2@tcp:700:mkdir.0 Request processed in 95us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364921.470311:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:0.0:1787364921.478624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.478725:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688887808 00000100:00100000:1.0:1787364921.478736:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688887808 00000100:00100000:1.0:1787364921.478826:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:1.0:1787364921.478837:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:9695:x1874187688887808:12345-192.168.204.2@tcp:36:mkdir.0 00010000:00010000:1.0:1787364921.478894:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364921.478960:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2ae6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da77 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.478984:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787364921.478996:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364921.479374:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.479405:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.479435:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.479465:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.479473:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.479480:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364921.480766:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787364921.480780:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.480818:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.480826:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.480831:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364921.480835:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.480843:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.480856:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d12906800) 00010000:00010000:1.0:1787364921.480859:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364921.480871:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.480878:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2af8a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787364921.480896:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a636e508 reply state 00000000ae82b6d0 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364921.480905:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364921.481032:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:9695:x1874187688887808:12345-192.168.204.2@tcp:36:mkdir.0 Request processed in 2193us (2414us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787364921.481041:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 15 00010000:00010000:2.0:1787364921.484435:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.484464:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.484472:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.484478:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364921.484483:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.484491:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.484506:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b6d12906300) 00010000:00010000:2.0:1787364921.484509:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364921.484513:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.484520:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1400/0xcfc9272e5fc2af91 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364921.498521:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.498633:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688887936 00000100:00100000:2.0:1787364921.498643:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688887936 00000100:00100000:2.0:1787364921.498703:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:2.0:1787364921.498713:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:9696:x1874187688887936:12345-192.168.204.2@tcp:101:chmod.0 00010000:00010000:2.0:1787364921.498737:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364921.498763:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2af98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dafc expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.498912:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2af9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.498928:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2af9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.498940:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2af9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364921.499006:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787364921.499011:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364921.499061:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2af9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.499091:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2af98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dafc expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.499110:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2af9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dafc expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.499119:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:2.0:1787364921.499122:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787364921.499127:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35600, rc 0) 00000100:00100000:2.0:1787364921.499200:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:9696:x1874187688887936:12345-192.168.204.2@tcp:101:chmod.0 Request processed in 488us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364921.499209:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:3.0:1787364921.503337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.503454:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688888192 00000100:00100000:1.0:1787364921.503464:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688888192 00000100:00100000:1.0:1787364921.503528:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:1.0:1787364921.503540:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:9696:x1874187688888192:12345-192.168.204.2@tcp:36:chmod.0 00010000:00010000:1.0:1787364921.503597:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364921.503624:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2af9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dafc expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.503644:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:1.0:1787364921.503658:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364921.503684:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.503697:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.503706:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787364921.504532:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a13d9bc reply state 00000000e6742d4d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364921.504545:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787364921.504561:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787364921.504648:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+8:9696:x1874187688888192:12345-192.168.204.2@tcp:36:chmod.0 Request processed in 1110us (1409us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787364921.504657:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 17 00010000:00010000:1.0:1787364921.517593:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.517610:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.517618:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.517625:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364921.517630:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.517639:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.517654:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d12906800) 00010000:00010000:1.0:1787364921.517657:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787364921.517661:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.517667:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0a00/0xcfc9272e5fc2afa6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364921.564245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.565507:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688888320 00000100:00100000:2.0:1787364921.565521:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688888320 00000100:00100000:0.0:1787364921.568444:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:0.0:1787364921.568471:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:9697:x1874187688888320:12345-192.168.204.2@tcp:101:chown.0 00010000:00010000:0.0:1787364921.568501:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364921.568530:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2afad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db03 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.568599:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2afb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.568613:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2afb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.568627:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2afb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364921.568696:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787364921.568700:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787364921.568742:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2afb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.568781:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2afad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db03 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.568838:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2afb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db03 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.568847:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:0.0:1787364921.568850:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787364921.568853:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4200, rc 0) 00000100:00100000:0.0:1787364921.569036:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:9697:x1874187688888320:12345-192.168.204.2@tcp:101:chown.0 Request processed in 578us (4803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364921.569043:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:0.0:1787364921.588164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.588679:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688888448 00000100:00100000:1.0:1787364921.588690:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688888448 00000100:00100000:1.0:1787364921.588756:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:1.0:1787364921.588768:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+8:9697:x1874187688888448:12345-192.168.204.2@tcp:101:chown.0 00010000:00010000:1.0:1787364921.588825:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364921.588848:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2afbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.588920:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.588935:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.588947:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.588963:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.588970:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.588977:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.589078:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2afd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.589087:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2afd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.589108:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2afd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364921.589961:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787364921.589968:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364921.590000:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2afd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590015:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590022:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590028:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590034:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364921.590037:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590045:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590059:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:1.0:1787364921.590062:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364921.590067:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590074:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2afc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590101:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590107:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590113:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590117:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364921.590120:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590489:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590498:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b6d12906800) 00010000:00010000:1.0:1787364921.590500:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364921.590504:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590511:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2afc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590557:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2afbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db0a expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590572:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2afd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db0a expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.590594:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d12906b00) 00010000:00010000:1.0:1787364921.590597:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787364921.590600:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1600, rc 0) 00000100:00100000:1.0:1787364921.590730:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+9:9697:x1874187688888448:12345-192.168.204.2@tcp:101:chown.0 Request processed in 1963us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.590740:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:1.0:1787364921.606062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364921.607232:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688888704 00000100:00100000:3.0:1787364921.607254:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688888704 00000100:00100000:3.0:1787364921.607323:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:3.0:1787364921.607334:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:9697:x1874187688888704:12345-192.168.204.2@tcp:36:chown.0 00010000:00010000:3.0:1787364921.607389:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364921.607427:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2afd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db0a expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.607447:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d12906b00) 00010000:00010000:3.0:1787364921.607457:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364921.607481:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.607494:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.607504:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787364921.653287:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1787364921.653307:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787364921.653380:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006240e6a7 reply state 00000000289b1a20 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364921.653393:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787364921.653554:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787364921.653678:0:5857:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787364921.653697:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:9697:x1874187688888704:12345-192.168.204.2@tcp:36:chown.0 Request processed in 46362us (47642us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787364921.653706:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 20 00010000:00010000:2.0:1787364921.653742:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.653750:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.653758:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.653763:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364921.653768:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.653775:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.653820:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29500) 00010000:00010000:2.0:1787364921.653823:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787364921.653828:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.653834:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2afd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364921.687514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364921.688254:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688888832 00000100:00100000:3.0:1787364921.688273:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688888832 00000100:00100000:3.0:1787364921.688403:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:3.0:1787364921.688425:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:9698:x1874187688888832:12345-192.168.204.2@tcp:101:touch.500 00010000:00010000:3.0:1787364921.688463:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364921.689070:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2afde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db11 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787364921.690330:0:8228:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1067us 00010000:00010000:3.0:1787364921.712880:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.712905:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.712917:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.712933:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.712940:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.712947:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.714831:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2aff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.716545:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2aff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.716567:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2aff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364921.716740:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787364921.716744:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787364921.718547:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2aff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718569:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718575:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718581:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718587:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364921.718592:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718600:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718615:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:3.0:1787364921.718617:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364921.718622:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718628:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2afe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718642:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718661:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718667:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718672:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364921.718674:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718680:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718689:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b6d10b29c00) 00010000:00010000:3.0:1787364921.718691:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364921.718694:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718700:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2afec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718746:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2afde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db11 expref: 8 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718761:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2aff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db11 expref: 7 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.718767:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29600) 00010000:00010000:3.0:1787364921.718769:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787364921.718778:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:3.0:1787364921.720009:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:9698:x1874187688888832:12345-192.168.204.2@tcp:101:touch.500 Request processed in 31579us (32495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364921.720022:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:1.0:1787364921.732149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364921.732268:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688889088 00000100:00100000:0.0:1787364921.732277:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688889088 00000100:00100000:0.0:1787364921.732352:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:0.0:1787364921.732361:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:9698:x1874187688889088:12345-192.168.204.2@tcp:101:touch.500 00010000:00010000:0.0:1787364921.732381:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364921.732401:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4e00/0xcfc9272e5fc2affa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db18 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.732736:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.732751:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.732763:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.732820:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.732829:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.732835:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787364921.737428:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787364921.737739:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b00f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737757:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b00f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737770:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b00f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737838:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737846:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737853:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737860:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364921.737864:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737883:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737896:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29600) 00010000:00010000:0.0:1787364921.737900:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364921.737904:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737911:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4c00/0xcfc9272e5fc2b001 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787364921.737923:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fac3895 reply state 000000009a7bf9e5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364921.737932:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787364921.737968:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4e00/0xcfc9272e5fc2affa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db18 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737981:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b00f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db18 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.737989:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:0.0:1787364921.737992:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364921.737994:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4600, rc 0) 00000100:00100000:0.0:1787364921.738090:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+10:9698:x1874187688889088:12345-192.168.204.2@tcp:101:touch.500 Request processed in 5718us (5948us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787364921.738100:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:0.0:1787364921.749326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.749450:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688889344 00000100:00100000:1.0:1787364921.749464:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688889344 00000100:00100000:1.0:1787364921.749557:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:1.0:1787364921.749569:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+10:9698:x1874187688889344:12345-192.168.204.2@tcp:36:touch.500 00010000:00010000:1.0:1787364921.749656:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364921.749694:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b00f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db18 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.749718:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:1.0:1787364921.749732:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364921.749856:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.749873:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.749885:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787364921.750092:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf704b24 reply state 00000000ebd3badb transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364921.750102:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364921.750240:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+11:9698:x1874187688889344:12345-192.168.204.2@tcp:36:touch.500 Request processed in 672us (928us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787364921.750249:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 23 00010000:00010000:2.0:1787364921.750991:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.751003:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.751011:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.751017:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364921.751023:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.751033:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.751047:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff9b6d3c6a8c00) 00010000:00010000:2.0:1787364921.751051:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364921.751056:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.751063:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b008 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.754215:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.754255:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.754263:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.754271:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364921.754276:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.754285:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.754308:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d12906800) 00010000:00010000:0.0:1787364921.754311:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364921.754317:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364921.754324:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b01d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364921.754457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.754616:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688889472 00000100:00100000:2.0:1787364921.754630:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688889472 00000100:00100000:2.0:1787364921.754702:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:2.0:1787364921.754714:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:9698:x1874187688889472:12345-192.168.204.2@tcp:101:touch.500 00010000:00010000:2.0:1787364921.754745:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364921.754779:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b024 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db1f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.754897:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db1f expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.754913:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db1f expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.754936:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d104f9200) 00010000:00010000:2.0:1787364921.754939:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364921.754941:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35000, rc 0) 00000100:00100000:2.0:1787364921.755013:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+10:9698:x1874187688889472:12345-192.168.204.2@tcp:101:touch.500 Request processed in 301us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364921.755020:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:2.0:1787364921.760002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.760107:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688889600 00000100:00100000:1.0:1787364921.760122:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688889600 00000100:00100000:1.0:1787364921.760198:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:1.0:1787364921.760209:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2363:x1874187688889600:12345-192.168.204.2@tcp:8:touch.500 00010000:00080000:1.0:1787364921.760255:0:8229:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:1.0:1787364921.760300:0:8229:0:(genops.c:1385:class_connect()) connect: client 6b97b2b3-6991-434b-88a0-aee779536483, cookie 0xcfc9272e5fc2b02b 00002000:00100000:1.0:1787364921.760318:0:8229:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6b97b2b3-6991-434b-88a0-aee779536483/ffff9b6c06b0e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787364921.760348:0:8229:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787364921.760672:0:8229:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787364921.760742:0:8229:0:(import.c:65:import_set_state_nolock()) ffff9b6d055e1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787364921.761064:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2363:x1874187688889600:12345-192.168.204.2@tcp:8:touch.500 Request processed in 854us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.761076:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:1.0:1787364921.765800:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.767935:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688889728 00000100:00100000:2.0:1787364921.768339:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688889728 00000100:00100000:2.0:1787364921.768781:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:2.0:1787364921.768832:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:0:x1874187688889728:12345-192.168.204.2@tcp:2:touch.500 00000100:00080000:1.0:1787364921.774366:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787364921.858697:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000001:00080000:3.0:1787364921.858717:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787364921.858942:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:0:x1874187688889728:12345-192.168.204.2@tcp:2:touch.500 Request processed in 90108us (93166us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787364921.858953:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:3.0:1787364921.867131:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787364921.870485:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714093184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364921.870570:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364921.870625:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714093056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364921.870643:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364921.870677:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714093184 00000100:00100000:3.0:1787364921.870684:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714093184 00000100:00100000:3.0:1787364921.870722:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714093056 00000100:00100000:3.0:1787364921.870725:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714093056 00000100:00100000:3.0:1787364921.870740:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787364921.870747:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714093184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364921.870809:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364921.870851:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714093184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364921.870858:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787364921.870874:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787364921.870880:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714093056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364921.870889:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364921.870909:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714093056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364921.870930:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787364921.870962:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3fddad80 x1874187714093184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364921.870981:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714093184:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787364921.870990:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d07d2f100 x1874187714093056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364921.871000:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714093056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364921.874975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.875096:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688889984 00000100:00100000:1.0:1787364921.875106:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688889984 00000100:00100000:1.0:1787364921.875175:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:1.0:1787364921.875186:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+10:9698:x1874187688889984:12345-192.168.204.2@tcp:35:touch.500 00000100:00100000:1.0:1787364921.875544:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+11:9698:x1874187688889984:12345-192.168.204.2@tcp:35:touch.500 Request processed in 359us (579us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787364921.875553:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:3.0:1787364921.911066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.911175:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688890112 00000100:00100000:1.0:1787364921.911185:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688890112 00000100:00100000:1.0:1787364921.911244:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:1.0:1787364921.911255:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+11:9699:x1874187688890112:12345-192.168.204.2@tcp:101:rm.0 00010000:00010000:1.0:1787364921.911281:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364921.911301:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db26 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.911370:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b039 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.911384:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.911398:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364921.911461:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787364921.911466:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364921.911511:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.911549:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db26 expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.911582:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db26 expref: 12 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.911591:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29600) 00010000:00010000:1.0:1787364921.911594:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787364921.911597:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0600, rc 0) 00000100:00100000:1.0:1787364921.911661:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+12:9699:x1874187688890112:12345-192.168.204.2@tcp:101:rm.0 Request processed in 408us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.911667:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:0.0:1787364921.919059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.919674:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688890368 00000100:00100000:2.0:1787364921.919686:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688890368 00000100:00100000:2.0:1787364921.919754:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 26 00000100:00100000:2.0:1787364921.919765:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+12:9699:x1874187688890368:12345-192.168.204.2@tcp:101:rm.0 00010000:00010000:2.0:1787364921.919827:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364921.919849:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b040 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db2d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364921.919992:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787364921.920165:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b040 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db2d expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.920181:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:2.0:1787364921.920184:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787364921.920189:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b040 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db2d expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.920203:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35a00, rc 0) 00000100:00100000:2.0:1787364921.920264:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+13:9699:x1874187688890368:12345-192.168.204.2@tcp:101:rm.0 Request processed in 502us (1216us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787364921.920272:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 26 00000100:00100000:2.0:1787364921.926907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.927011:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688890496 00000100:00100000:1.0:1787364921.927023:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688890496 00000100:00100000:1.0:1787364921.927086:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:1.0:1787364921.927098:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+13:9699:x1874187688890496:12345-192.168.204.2@tcp:37:rm.0 00010000:00010000:1.0:1787364921.931346:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364921.934759:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+13:9699:x1874187688890496:12345-192.168.204.2@tcp:37:rm.0 Request processed in 7651us (7851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.934775:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:0.0:1787364921.939768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.940050:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688890752 00000100:00100000:2.0:1787364921.940061:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688890752 00000100:00100000:2.0:1787364921.940131:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:2.0:1787364921.940149:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0631e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+13:9699:x1874187688890752:12345-192.168.204.2@tcp:35:rm.0 00000100:00100000:2.0:1787364921.940630:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0631e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:9699:x1874187688890752:12345-192.168.204.2@tcp:35:rm.0 Request processed in 481us (870us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787364921.940639:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:2.0:1787364921.949544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.949687:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688891008 00000100:00100000:1.0:1787364921.949697:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688891008 00000100:00100000:1.0:1787364921.949754:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 27 00000100:00100000:1.0:1787364921.949765:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+14:9699:x1874187688891008:12345-192.168.204.2@tcp:101:rm.0 00010000:00010000:1.0:1787364921.949828:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364921.949852:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b04e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db34 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.950009:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b055 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.950026:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.950037:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364921.950050:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787364921.950214:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b04e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db34 expref: 17 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.950235:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db34 expref: 16 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.950244:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29600) 00010000:00010000:1.0:1787364921.950247:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787364921.950250:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1c00, rc 0) 00000100:00100000:1.0:1787364921.950312:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+16:9699:x1874187688891008:12345-192.168.204.2@tcp:101:rm.0 Request processed in 548us (788us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787364921.950321:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 27 00000100:00100000:3.0:1787364921.955495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364921.956235:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688891136 00000100:00100000:2.0:1787364921.956246:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688891136 00000100:00100000:2.0:1787364921.956310:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 28 00000100:00100000:2.0:1787364921.956320:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+16:9699:x1874187688891136:12345-192.168.204.2@tcp:41:rm.0 00000004:00000024:2.0:1787364921.956397:0:5857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787364921.956487:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+16:9699:x1874187688891136:12345-192.168.204.2@tcp:41:rm.0 Request processed in 168us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364921.956495:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 28 00000100:00100000:0.0:1787364921.972003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364921.972124:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688891264 00000100:00100000:1.0:1787364921.972141:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688891264 00000100:00100000:1.0:1787364921.972210:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:1.0:1787364921.972223:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+16:9699:x1874187688891264:12345-192.168.204.2@tcp:101:rm.0 00010000:00010000:1.0:1787364921.972248:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364921.972287:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db3b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.972415:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.972432:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.972443:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.972458:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.972464:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.972469:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973301:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973314:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973323:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364921.973353:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787364921.973357:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364921.973378:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973466:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973476:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973482:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973489:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973495:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364921.973498:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973505:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973516:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29600) 00010000:00010000:1.0:1787364921.973585:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364921.973592:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973599:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b06a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973615:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973621:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973634:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973639:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364921.973641:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973648:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973656:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff9b6d12906b00) 00010000:00010000:1.0:1787364921.973658:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364921.973661:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973667:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973703:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db3b expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973717:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db3b expref: 17 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364921.973724:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d104f9200) 00010000:00010000:1.0:1787364921.973725:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364921.973728:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1800, rc 0) 00000100:00100000:1.0:1787364921.974717:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+17:9699:x1874187688891264:12345-192.168.204.2@tcp:101:rm.0 Request processed in 2488us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364921.974742:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:2.0:1787364921.984283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364921.987477:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688891520 00000100:00100000:3.0:1787364921.987492:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688891520 00000100:00100000:3.0:1787364921.987573:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00100000:3.0:1787364921.987586:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+17:9699:x1874187688891520:12345-192.168.204.2@tcp:36:rm.0 00010000:00010000:3.0:1787364921.987651:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787364921.987692:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db3b expref: 17 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.987717:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b024 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db1f expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.987728:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d104f9200) 00010000:00010000:3.0:1787364921.987745:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b039 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db26 expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.987753:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29600) 00010000:00010000:3.0:1787364921.987771:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364921.988298:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.988314:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.988325:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.988341:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.988348:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.988354:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.988479:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.988487:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.988493:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787364921.994337:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787364921.994362:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368223575271ns, next at 369223571231ns, rc = 0 00010000:00010000:2.0:1787364921.994456:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994473:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994485:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994494:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994501:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994507:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994532:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787364921.994554:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994560:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994584:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994590:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364921.994595:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994602:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994614:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d10b29900) 00010000:00010000:2.0:1787364921.994617:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787364921.994622:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994628:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b08d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994648:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994654:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994659:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994664:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364921.994667:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994683:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994692:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29600) 00010000:00010000:2.0:1787364921.994694:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364921.994697:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364921.994703:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b07f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787364921.994712:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7103f36 reply state 00000000852c78b4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364921.994721:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787364921.994857:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+16:9699:x1874187688891520:12345-192.168.204.2@tcp:36:rm.0 Request processed in 7270us (10578us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787364921.994866:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 30 00010000:00010000:3.0:1787364921.996294:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787364921.996305:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.996313:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e34800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364921.996329:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.996337:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.996351:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d10b29900) 00010000:00010000:3.0:1787364921.996354:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787364921.996358:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.996364:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.996384:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364921.996386:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364921.996388:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364921.998341:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.998358:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.998364:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.998371:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364921.998375:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.998383:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.998417:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff9b6d10b29c00) 00010000:00010000:3.0:1787364921.998421:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364921.998426:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364921.998432:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b086 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364922.001228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364922.001377:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688891776 00000100:00100000:1.0:1787364922.001390:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688891776 00000100:00100000:1.0:1787364922.001452:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:1.0:1787364922.001462:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+15:9699:x1874187688891776:12345-192.168.204.2@tcp:35:rm.0 00000100:00100000:1.0:1787364922.001730:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+16:9699:x1874187688891776:12345-192.168.204.2@tcp:35:rm.0 Request processed in 269us (510us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787364922.001737:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:2.0:1787364922.008503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364922.008582:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688892032 00000100:00100000:3.0:1787364922.008593:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688892032 00000100:00100000:3.0:1787364922.008654:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 31 00000100:00100000:3.0:1787364922.008664:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+16:9699:x1874187688892032:12345-192.168.204.2@tcp:36:rm.0 00010000:00010000:3.0:1787364922.008728:0:8228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787364922.008757:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b055 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db34 expref: 16 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364922.008782:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2aff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db11 expref: 15 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364922.008857:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d10b29600) 00010000:00010000:3.0:1787364922.008890:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2afb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db03 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364922.008901:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:3.0:1787364922.008908:0:8228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364922.009019:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.009035:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.009047:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.009061:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.009068:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.009157:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.009493:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.009503:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.009527:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364922.013365:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787364922.013397:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.013407:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.013415:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.013420:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364922.013425:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.013432:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.013461:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364922.013464:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787364922.013469:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.013475:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1600/0xcfc9272e5fc2b0a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.013503:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.013508:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.014189:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.014196:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364922.014199:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.014206:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.014216:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d12906b00) 00010000:00010000:1.0:1787364922.014219:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364922.014222:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.014227:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b09b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787364922.014241:0:8228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094a6fdb6 reply state 0000000025dd3ac3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364922.014250:0:8228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364922.014424:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+15:9699:x1874187688892032:12345-192.168.204.2@tcp:36:rm.0 Request processed in 5756us (5938us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787364922.014433:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 31 00010000:00010000:1.0:1787364922.020335:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.020354:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.020384:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.020391:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364922.020396:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.020405:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.020425:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b6d12906100) 00010000:00010000:1.0:1787364922.020429:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364922.020433:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.020440:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b0a2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364922.954915:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364923.979037:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364924.190667:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364924.190719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364924.190836:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688892160 00000100:00100000:1.0:1787364924.190846:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688892160 00000100:00100000:1.0:1787364924.190915:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 255 00000100:00100000:1.0:1787364924.190926:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688892160:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364924.191011:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688892160:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 87us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364924.191019:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 255 00000100:00100000:2.0:1787364924.194875:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364924.194930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364924.195109:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688892288 00000100:00100000:0.0:1787364924.195129:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688892288 00000100:00100000:0.0:1787364924.195202:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688892544 00000100:00100000:0.0:1787364924.195206:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688892544 00000100:00100000:0.0:1787364924.195228:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 113 00000100:00100000:0.0:1787364924.195238:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+14:2367:x1874187688892288:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364924.195334:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+14:2367:x1874187688892288:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 97us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364924.195343:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 113 00000100:00100000:0.0:1787364924.195360:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 114 00000100:00100000:0.0:1787364924.195367:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688892544:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364924.195392:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688892544:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364924.195398:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 114 00000100:00080000:2.0:1787364924.195776:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364924.196035:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688892416 00000100:00100000:3.0:1787364924.196049:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688892416 00000100:00100000:3.0:1787364924.196251:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00100000:3.0:1787364924.196260:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688892416:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364924.196312:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688892416:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 53us (5592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364924.196319:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00080000:2.0:1787364924.200583:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787364925.003154:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364926.028474:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364926.475103:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714093568:0@lo:400:kworker.0 00000100:00100000:0.0:1787364926.475180:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364926.475252:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364926.475258:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714093696:0@lo:400:kworker.0 00000100:00100000:0.0:1787364926.475286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364926.475327:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714093568 00000100:00100000:0.0:1787364926.475335:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714093568 00000100:00100000:2.0:1787364926.475472:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714093440:0@lo:400:kworker.0 00000100:00100000:2.0:1787364926.475504:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364926.475530:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714093952:0@lo:400:kworker.0 00000100:00100000:2.0:1787364926.475552:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364926.475613:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787364926.475618:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714093312:0@lo:400:kworker.0 00000100:00100000:2.0:1787364926.475645:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364926.475665:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714093824:0@lo:400:kworker.0 00000100:00100000:2.0:1787364926.475701:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364926.475899:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714093440 00000100:00100000:1.0:1787364926.475911:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714093440 00000100:00100000:0.0:1787364926.476030:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787364926.476042:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714093568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364926.476119:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714093568:12345-0@lo:400:kworker.0 Request processed in 80us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364926.476172:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714093568:0@lo:400:kworker.0 00000100:00100000:1.0:1787364926.477846:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714093824 00000100:00100000:1.0:1787364926.477857:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714093824 00000100:00100000:1.0:1787364926.477893:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787364926.477902:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714093440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364926.477979:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714093440:12345-0@lo:400:kworker.0 Request processed in 77us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364926.477986:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787364926.478003:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787364926.478009:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714093824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364926.478126:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714093824:12345-0@lo:400:kworker.0 Request processed in 116us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364926.478132:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787364926.478155:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714093696 00000100:00100000:1.0:1787364926.478159:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714093696 00000100:00100000:1.0:1787364926.478187:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714093952 00000100:00100000:1.0:1787364926.478190:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714093952 00000100:00100000:1.0:1787364926.478211:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787364926.478217:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714093696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364926.478254:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714093696:12345-0@lo:400:kworker.0 Request processed in 37us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364926.478260:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787364926.478272:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787364926.478278:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714093952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364926.478305:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714093952:12345-0@lo:400:kworker.0 Request processed in 28us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364926.478324:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787364926.478351:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714093312 00000100:00100000:1.0:1787364926.478355:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714093312 00000100:00100000:1.0:1787364926.478378:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787364926.478385:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714093312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364926.478677:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714093312:12345-0@lo:400:kworker.0 Request processed in 280us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364926.478684:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787364926.478939:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714093312:0@lo:400:kworker.0 00000100:00100000:1.0:1787364926.478956:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714093824:0@lo:400:kworker.0 00000100:00100000:1.0:1787364926.478966:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714093440:0@lo:400:kworker.0 00010000:00080000:1.0:1787364926.478979:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbc000 x1874187714093952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364926.478990:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714093952:0@lo:400:kworker.0 00010000:00080000:1.0:1787364926.479112:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbd880 x1874187714093696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364926.479123:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714093696:0@lo:400:kworker.0 00000100:00100000:0.0:1787364926.479203:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1787364926.479234:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787364926.479238:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787364926.479241:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787364926.843520:0:11635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1787364926.991378:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714094080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364926.991461:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364926.991543:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714094080 00000100:00100000:0.0:1787364926.991551:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714094080 00000100:00100000:0.0:1787364926.991606:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787364926.991616:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714094080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787364926.991652:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364926.991696:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714094080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364926.991704:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787364926.991744:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbce00 x1874187714094080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364926.991765:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714094080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364926.994831:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714094208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364926.994902:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787364926.995000:0:8064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373224212778ns, next at 374224210693ns, rc = 0 00000100:00100000:3.0:1787364926.995118:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714094208 00000100:00100000:3.0:1787364926.995126:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714094208 00000100:00100000:3.0:1787364926.995828:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787364926.995841:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714094208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364926.995878:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364926.995936:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714094208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364926.995944:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787364926.996682:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4079ce00 x1874187714094208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364926.996704:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714094208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364927.051427:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787364927.097067:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967300 is committed 00000001:00080000:2.0:1787364927.097102:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787364927.097139:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787364927.097450:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714094336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787364927.097513:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364927.097591:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714094336 00000100:00100000:2.0:1787364927.097598:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714094336 00000100:00100000:2.0:1787364927.097639:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787364927.097647:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714094336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787364927.097670:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787364927.097701:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a890638, atime: 0x6a890638, ctime: 0x6a890638, blocks: 0x1 00010000:00010000:2.0:1787364927.097709:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.097726:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1787364927.097730:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364927.097737:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.097767:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.097777:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.097911:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.097929:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787364927.099347:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874187714094336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1500us (1633us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787364927.099359:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787364927.099389:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787364927.099396:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.099408:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e35a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364927.099412:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.099422:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.099442:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.099461:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b35e90/0xcfc9272e5fc2b0b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364927.099483:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364927.099485:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364927.099487:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787364927.099668:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d4079c380/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787364927.099675:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714094336:0@lo:6:osp-syn-1-0.0 00000020:00000080:0.0:1787364927.998985:0:11685:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdddc46940 20000000:00000080:0.0:1787364927.999005:0:11685:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d409d1400 uarg=0000000000000000 20000000:01000000:0.0:1787364927.999063:0:11685:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787364927.999070:0:11685:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787364927.999074:0:11685:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787364927.999986:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787364928.000139:0:11685:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787364928.005690:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787364928.005750:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787364928.005987:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787364928.006031:0:11685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787364928.006053:0:11685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006073:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006093:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006101:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006107:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006114:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006121:0:11685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006160:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006175:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 18 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364928.006189:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094464:0@lo:104: 00000100:00100000:3.0:1787364928.006271:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787364928.006370:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.006378:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 18 pid: 5851 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364928.006397:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40d7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094592:0@lo:104: 00000100:00100000:3.0:1787364928.006421:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787364928.012107:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.012126:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 18 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364928.012141:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40d7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094720:0@lo:104: 00000100:00100000:3.0:1787364928.012204:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364928.012576:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714094464 00000100:00100000:0.0:1787364928.012585:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714094464 00000100:00100000:0.0:1787364928.012631:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714094592 00000100:00100000:0.0:1787364928.012634:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714094592 00000100:00100000:0.0:1787364928.012648:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787364928.012657:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:11685:x1874187714094464:12345-0@lo:104: 00010000:00010000:0.0:1787364928.012671:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364928.012776:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787364928.012806:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:11685:x1874187714094464:12345-0@lo:104: Request processed in 127us (6513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364928.012825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787364928.012844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787364928.012851:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11685:x1874187714094592:12345-0@lo:104: 00010000:00010000:0.0:1787364928.012859:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.012960:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.012972:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 12 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364928.012983:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40d7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094848:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364928.013069:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.013078:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 12 pid: 5850 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364928.013087:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40d7ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094976:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364928.013110:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0785b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787364928.013134:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094464:0@lo:104: 00000100:00100000:3.0:1787364928.013144:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40d7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094592:0@lo:104: 00010000:00010000:2.0:1787364928.014863:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787364928.014877:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.014889:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c8a00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:2.0:1787364928.014893:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.014904:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787364928.014912:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364928.014918:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787364928.014987:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015065:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787364928.015093:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015100:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8a00/0xcfc9272e5fc2af7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af83 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015132:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787364928.015135:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015141:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c9600 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:2.0:1787364928.015145:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015151:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787364928.015158:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787364928.015163:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787364928.015180:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015185:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787364928.015202:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015208:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9600/0xcfc9272e5fc2af6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015219:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364928.015221:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364928.015223:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364928.015511:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714095104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787364928.015691:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364928.015742:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714095232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787364928.015765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364928.015817:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714095104 00000100:00100000:2.0:1787364928.015824:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714095104 00010000:00010000:2.0:1787364928.015849:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 19 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364928.015872:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714095232 00000100:00100000:2.0:1787364928.015875:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714095232 00010000:00010000:2.0:1787364928.015886:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 20 pid: 5851 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364928.015900:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787364928.015908:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+20:3316:x1874187714095104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787364928.015919:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364928.015923:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 20 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015936:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 20 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.015950:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e35400/0xcfc9272e5fc2af83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2af7c expref: 20 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.019128:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364928.019235:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714095104:12345-0@lo:103:ldlm_bl.0 Request processed in 3322us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364928.019247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787364928.020171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787364928.020182:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:3313:x1874187714095232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787364928.020201:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364928.020209:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 18 pid: 5851 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.020225:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 18 pid: 5851 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.020246:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d013c9c00/0xcfc9272e5fc2af75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2af6e expref: 18 pid: 5851 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.020260:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364928.020308:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:3313:x1874187714095232:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (4542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364928.020315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787364928.020358:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714095232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787364928.020394:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714095104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787364928.020480:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714094720 00000100:00100000:1.0:1787364928.020488:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714094720 00000100:00100000:1.0:1787364928.020625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364928.020650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00010000:00010000:0.0:1787364928.020743:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787364928.020753:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+4:11685:x1874187714094592:12345-0@lo:104: Request processed in 7901us (14329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364928.020762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787364928.020823:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787364928.020839:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787364928.020847:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40187c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11685:x1874187714094720:12345-0@lo:104: 00010000:00010000:0.0:1787364928.020859:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364928.020896:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787364928.020901:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40187c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+3:11685:x1874187714094720:12345-0@lo:104: Request processed in 57us (8698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364928.020908:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787364928.020983:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787364928.020990:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364928.021010:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e34e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787364928.021022:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364928.021032:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787364928.021039:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364928.021045:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787364928.021083:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364928.021090:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787364928.021103:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364928.021110:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34e00/0xcfc9272e5fc2af60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2af67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364928.021125:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364928.021127:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364928.021137:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364928.021312:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40d7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094720:0@lo:104: 00000100:00100000:3.0:1787364928.021324:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40d7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094848:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364928.021332:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40d7ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1874187714094976:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364928.021359:0:11685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364928.021752:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688892672 00000100:00100000:2.0:1787364928.021760:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688892672 00010000:00010000:2.0:1787364928.021815:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 13 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364928.021840:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688892800 00000100:00100000:2.0:1787364928.021843:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688892800 00010000:00010000:2.0:1787364928.021856:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 14 pid: 5850 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364928.021869:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00100000:2.0:1787364928.021885:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf99abb4-88a3-48fa-9491-b4225d983398+14:2367:x1874187688892672:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364928.021896:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364928.021901:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 14 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.021909:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 14 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.021923:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d013c8000/0xcfc9272e5fc2af59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daf5 expref: 14 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.021936:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364928.021982:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688892672:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 99us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364928.021989:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00100000:2.0:1787364928.022110:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:2.0:1787364928.022116:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf99abb4-88a3-48fa-9491-b4225d983398+12:2367:x1874187688892800:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364928.022123:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364928.022128:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 12 pid: 5850 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022135:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 12 pid: 5850 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022145:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e5200/0xcfc9272e5fc2af52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67daee expref: 12 pid: 5850 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022153:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364928.022179:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf99abb4-88a3-48fa-9491-b4225d983398+11:2367:x1874187688892800:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 62us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364928.022185:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:2.0:1787364928.022210:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714095360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787364928.022248:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787364928.022305:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364928.022314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714095360 00000100:00100000:2.0:1787364928.022317:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714095360 00010000:00010000:2.0:1787364928.022331:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 17 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364928.022344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787364928.022349:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:3314:x1874187714095360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787364928.022356:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364928.022360:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 17 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022368:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 17 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022378:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0c00/0xcfc9272e5fc2af67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2af60 expref: 17 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022388:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022396:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022409:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022422:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022428:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022434:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022439:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364928.022443:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022450:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022460:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364928.022468:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364928.022499:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3314:x1874187714095360:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364928.022505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787364928.022532:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714095360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787364928.023169:0:11685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.023181:0:11685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364928.023188:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2b0b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364928.083642:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364929.100869:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364929.309227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364929.309499:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688893056 00000100:00100000:1.0:1787364929.309510:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688893056 00000100:00100000:1.0:1787364929.309604:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 118 00000100:00100000:1.0:1787364929.309616:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688893056:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364929.309714:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688893056:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 100us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364929.309723:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 118 00000100:00080000:0.0:1787364929.309851:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364929.310204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364929.311587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364929.313705:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688893312 00000100:00100000:1.0:1787364929.313719:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688893312 00000100:00100000:1.0:1787364929.313849:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 119 00000100:00100000:1.0:1787364929.313860:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688893312:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364929.313953:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688893312:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 95us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364929.313960:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 119 00000100:00100000:1.0:1787364929.314626:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00080000:2.0:1787364929.315064:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364929.315511:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688893184 00000100:00100000:3.0:1787364929.315520:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688893184 00000100:00100000:3.0:1787364929.315588:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 67 00000100:00100000:3.0:1787364929.315597:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688893184:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364929.315653:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688893184:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 58us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364929.315661:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 67 00000100:00080000:2.0:1787364929.316183:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787364929.317544:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688892928 00000100:00100000:0.0:1787364929.317556:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688892928 00000100:00100000:0.0:1787364929.317627:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 257 00000100:00100000:0.0:1787364929.317636:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+11:2367:x1874187688892928:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364929.317716:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+11:2367:x1874187688892928:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 80us (7512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364929.317738:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 257 10000000:01000000:0.0:1787364929.738923:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787364929.738932:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6c06f84800 from 7 10000000:01000000:0.0:1787364929.738937:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787364929.739001:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.739014:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.739026:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364929.739056:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714095488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.739157:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.739224:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364929.739359:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714095488 00000100:00100000:1.0:1787364929.739367:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714095488 00000100:00100000:1.0:1787364929.739429:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787364929.739440:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:5853:x1874187714095488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364929.739454:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364929.739468:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2b0c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2b0be expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.739491:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2b0c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0be expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.739521:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2b0c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0be expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.739531:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1400, rc 0) 00000100:00100000:1.0:1787364929.739582:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714095488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364929.739590:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787364929.739845:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714095488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787364929.739861:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.739870:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364929.739931:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714095616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.739960:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.740003:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.740093:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714095616 00000100:00100000:2.0:1787364929.740098:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714095616 00000100:00100000:2.0:1787364929.740133:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787364929.740142:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714095616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364929.740405:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714095616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.740413:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787364929.740898:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714095616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.740946:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714095744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.741000:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.741032:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.741199:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714095744 00000100:00100000:2.0:1787364929.741204:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714095744 00000100:00100000:2.0:1787364929.741242:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787364929.741250:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714095744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364929.741423:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714095744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.741431:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787364929.741614:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714095744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.743161:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11698:1874187714095872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364929.743228:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.743338:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.743456:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714095872 00000100:00100000:2.0:1787364929.743463:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714095872 00000100:00100000:2.0:1787364929.743554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787364929.743563:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:11698:x1874187714095872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364929.743766:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:11698:x1874187714095872:12345-0@lo:502:llog_process_th.0 Request processed in 203us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.743774:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787364929.743877:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11698:1874187714095872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787364929.743903:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787364929.743911:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364929.743914:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787364929.743919:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6c06f84800 00000020:00000080:0.0:1787364929.743921:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787364929.744018:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11698:1874187714096000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364929.744048:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.774871:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364929.774997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364929.780941:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714096000 00000100:00100000:1.0:1787364929.780958:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714096000 00000100:00100000:1.0:1787364929.781067:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787364929.781078:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:11698:x1874187714096000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364929.781476:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:11698:x1874187714096000:12345-0@lo:502:llog_process_th.0 Request processed in 399us (37425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364929.781484:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787364929.781565:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11698:1874187714096000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787364929.781600:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787364929.781608:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364929.781611:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787364929.781618:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787364929.781935:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787364929.781953:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787364929.782323:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.782336:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787364929.782362:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787364929.782365:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d055cd000 from 7 10000000:01000000:1.0:1787364929.782368:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787364929.782400:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.782408:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.782417:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364929.782438:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787364929.782482:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364929.782508:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c052d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364929.782527:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714096128 00000100:00100000:1.0:1787364929.782532:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714096128 00000100:00100000:1.0:1787364929.782562:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787364929.782570:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:5853:x1874187714096128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364929.782580:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364929.782592:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2b0d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2b0cc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.782613:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2b0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0cc expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.782623:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2b0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0cc expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.782643:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1600, rc 0) 00000100:00100000:1.0:1787364929.782678:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714096128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364929.782685:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787364929.785130:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787364929.785158:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364929.785171:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364929.785420:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688893440 00000100:00100000:0.0:1787364929.785427:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688893440 00000100:00100000:0.0:1787364929.785468:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 264 00000100:00100000:0.0:1787364929.785479:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+11:5608:x1874187688893440:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787364929.785494:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364929.785513:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e4c00/0xcfc9272e5fc2b0da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.785537:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e4c00/0xcfc9272e5fc2b0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db42 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.785559:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e4c00/0xcfc9272e5fc2b0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db42 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.785568:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4c00, rc 0) 00000100:00100000:0.0:1787364929.785625:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688893440:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 Request processed in 148us (10633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364929.785633:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 264 00000100:00100000:1.0:1787364929.788822:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787364929.788902:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364929.788941:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c052d19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.789393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364929.789424:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714096256 00000100:00100000:2.0:1787364929.789432:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714096256 00000100:00100000:2.0:1787364929.789474:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688893568 00000100:00100000:2.0:1787364929.789477:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688893568 00000100:00100000:2.0:1787364929.789493:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787364929.789517:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714096256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.790130:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 266 00000100:00100000:0.0:1787364929.790142:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688893568:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.790864:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688893568:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 Request processed in 722us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364929.790876:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 266 00000100:00100000:2.0:1787364929.792145:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714096256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2626us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.792156:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787364929.793391:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.793451:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.793523:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.793558:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.794454:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714096384 00000100:00100000:2.0:1787364929.794463:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714096384 00000100:00100000:2.0:1787364929.794518:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787364929.794528:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714096384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364929.795122:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714096384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 594us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.795132:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787364929.796098:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.799170:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11701:1874187714096512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364929.800362:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.800419:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd5240 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.802873:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714096512 00000100:00100000:2.0:1787364929.802888:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714096512 00000100:00100000:2.0:1787364929.802949:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787364929.802971:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:11701:x1874187714096512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364929.803250:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:11701:x1874187714096512:12345-0@lo:502:llog_process_th.0 Request processed in 291us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.803269:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787364929.808499:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11701:1874187714096512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787364929.808557:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787364929.808575:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364929.808578:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787364929.808584:0:11701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d055cd000 00000020:00000080:0.0:1787364929.808586:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787364929.808682:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11701:1874187714096640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787364929.808764:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.808835:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d14344b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.809267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364929.809415:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714096640 00000100:00100000:2.0:1787364929.809420:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714096640 00000100:00100000:2.0:1787364929.809460:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688893696 00000100:00100000:2.0:1787364929.809463:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688893696 00000100:00100000:2.0:1787364929.809477:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787364929.809485:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:11701:x1874187714096640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364929.809675:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:11701:x1874187714096640:12345-0@lo:502:llog_process_th.0 Request processed in 189us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.809687:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787364929.809738:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 270 00000100:00100000:2.0:1787364929.809746:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688893696:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364929.809861:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688893696:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 Request processed in 114us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.809867:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 270 00000100:00100000:0.0:1787364929.811433:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11701:1874187714096640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787364929.811470:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787364929.811480:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787364929.811482:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787364929.811486:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787364929.811546:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787364929.811566:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787364929.811575:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.811586:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787364929.811597:0:5853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787364929.811600:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d20269000 from 7 10000000:01000000:0.0:1787364929.811602:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787364929.811631:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.811639:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.811649:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364929.811672:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.811733:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364929.811763:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.813613:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714096768 00000100:00100000:2.0:1787364929.813625:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714096768 00000100:00100000:2.0:1787364929.813671:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787364929.813680:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:5853:x1874187714096768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364929.813706:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364929.813724:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40e34000/0xcfc9272e5fc2b0e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2b0e1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364929.813753:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40e34000/0xcfc9272e5fc2b0e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0e1 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364929.813764:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40e34000/0xcfc9272e5fc2b0e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0e1 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364929.813773:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e34000, rc 0) 00000100:00100000:2.0:1787364929.813864:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714096768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.813872:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787364929.813931:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787364929.813946:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364929.813977:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364929.814051:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364929.814092:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364929.814119:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c05f86c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787364929.814408:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714096896 00000100:00100000:0.0:1787364929.814412:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714096896 00000100:00100000:0.0:1787364929.814434:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787364929.814440:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714096896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.814641:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714096896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364929.814648:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787364929.815172:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714096896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787364929.815210:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714097024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364929.817430:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364929.817497:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c05f86c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.817526:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714097024 00000100:00100000:2.0:1787364929.817533:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714097024 00000100:00100000:2.0:1787364929.817587:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787364929.817597:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d054af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714097024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787364929.818181:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d054af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:5853:x1874187714097024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 583us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.818189:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787364929.819075:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8853f36b-eb15-4321-aed5-724dfa11fdc2:5853:1874187714097024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787364929.820908:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787364929.823226:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11703:1874187714097152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364929.825058:0:11703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364929.825116:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd5240 going to sleep for 11 seconds 00000100:00100000:2.0:1787364929.826893:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714097152 00000100:00100000:2.0:1787364929.826904:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714097152 00000100:00100000:2.0:1787364929.826956:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787364929.827419:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:11703:x1874187714097152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787364929.827730:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:11703:x1874187714097152:12345-0@lo:502:llog_process_th.0 Request processed in 317us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364929.827839:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11703:1874187714097152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787364929.827878:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787364929.827889:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364929.827891:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787364929.827902:0:11703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d20269000 00000020:00000080:1.0:1787364929.827904:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787364929.828007:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11703:1874187714097280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364929.828051:0:11703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364929.828096:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714097280 00000100:00100000:1.0:1787364929.828101:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714097280 00000100:00100000:0.0:1787364929.835476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364929.835525:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688893824 00000100:00100000:0.0:1787364929.835534:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688893824 00000100:00100000:0.0:1787364929.835577:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 275 00000100:00100000:0.0:1787364929.835587:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:9970:x1874187688893824:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787364929.835867:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+12:9970:x1874187688893824:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 281us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364929.835875:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 275 00000100:00100000:2.0:1787364929.836830:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787364929.841897:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787364929.841920:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:11703:x1874187714097280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787364929.842208:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:11703:x1874187714097280:12345-0@lo:502:llog_process_th.0 Request processed in 296us (14155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364929.842217:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787364929.842288:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02dd5240 going to sleep for 11 seconds 00000100:00100000:1.0:1787364929.842314:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8853f36b-eb15-4321-aed5-724dfa11fdc2:11703:1874187714097280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787364929.842357:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787364929.842366:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787364929.842368:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787364929.842374:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:2.0:1787364929.842861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000020:01000000:2.0:1787364929.842882:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787364929.842905:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787364929.842916:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364929.842927:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364929.842951:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688893952 00000100:00100000:2.0:1787364929.842968:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688893952 00000100:00100000:2.0:1787364929.843018:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 277 00000100:00100000:2.0:1787364929.843026:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+12:9970:x1874187688893952:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787364929.843195:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+12:9970:x1874187688893952:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 169us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364929.843202:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 277 00000100:00100000:2.0:1787364929.860742:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364929.860866:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688894080 00000100:00100000:0.0:1787364929.860878:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688894080 00000100:00100000:0.0:1787364929.860943:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 278 00000100:00100000:0.0:1787364929.860955:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+12:5608:x1874187688894080:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787364929.860994:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364929.861015:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e5800/0xcfc9272e5fc2b0ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db49 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.861069:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e5800/0xcfc9272e5fc2b0ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db49 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.861080:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e5800/0xcfc9272e5fc2b0ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db49 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364929.861089:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5800, rc 0) 00000100:00100000:0.0:1787364929.872866:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688894080:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 Request processed in 11900us (12123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364929.872879:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 278 00000100:00100000:2.0:1787364929.886495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364929.886576:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688894208 00000100:00100000:3.0:1787364929.886587:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688894208 00000100:00100000:3.0:1787364929.886647:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 279 00000100:00100000:3.0:1787364929.886657:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688894208:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787364929.886992:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688894208:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 Request processed in 335us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364929.887000:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 279 00000100:00100000:2.0:1787364929.890742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364929.892865:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688894336 00000100:00100000:0.0:1787364929.892883:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688894336 00000100:00100000:0.0:1787364929.893566:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 280 00000100:00100000:0.0:1787364929.893580:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688894336:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787364929.893846:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:5608:x1874187688894336:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 Request processed in 269us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364929.893855:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 280 00000100:00100000:2.0:1787364929.918104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364929.918176:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688894464 00000100:00100000:1.0:1787364929.918187:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688894464 00000100:00100000:1.0:1787364929.918241:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 281 00000100:00100000:1.0:1787364929.918260:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:9973:x1874187688894464:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787364929.918534:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:9973:x1874187688894464:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 275us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364929.918543:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 281 00000100:00100000:2.0:1787364929.927454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364929.927531:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688894592 00000100:00100000:3.0:1787364929.927541:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688894592 00000100:00100000:3.0:1787364929.927588:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 282 00000100:00100000:3.0:1787364929.927598:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:9973:x1874187688894592:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787364929.927879:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:9973:x1874187688894592:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 281us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364929.927887:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 282 00010000:00010000:1.0:1787364930.126840:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787364930.828575:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787364931.147462:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364931.595207:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714097792:0@lo:400:kworker.0 00000100:00100000:2.0:1787364931.595292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364931.595443:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714097664:0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.595478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364931.595512:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714097664 00000100:00100000:1.0:1787364931.595520:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714097664 00000100:00100000:1.0:1787364931.595582:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787364931.595593:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714097664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.595665:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714097664:12345-0@lo:400:kworker.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364931.595673:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1787364931.595713:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364931.595778:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714097536:0@lo:400:kworker.0 00000100:00100000:0.0:1787364931.595835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364931.596536:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714097536 00000100:00100000:1.0:1787364931.596542:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714097536 00000100:00100000:1.0:1787364931.596572:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787364931.596580:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714097536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.596629:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714097536:12345-0@lo:400:kworker.0 Request processed in 50us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364931.596636:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787364931.597469:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714097408:0@lo:400:kworker.0 00000100:00100000:3.0:1787364931.597519:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364931.597588:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714097408 00000100:00100000:1.0:1787364931.597593:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714097408 00000100:00100000:1.0:1787364931.597628:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787364931.597635:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714097408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.597673:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714097408:12345-0@lo:400:kworker.0 Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364931.597679:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787364931.597723:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714097792 00000100:00100000:1.0:1787364931.597728:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714097792 00000100:00100000:1.0:1787364931.597768:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787364931.597775:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714097792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.597827:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714097792:12345-0@lo:400:kworker.0 Request processed in 52us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364931.597833:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787364931.597847:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364931.601029:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714097664:0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.601116:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714097536:0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.601127:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714098048:0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.601199:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364931.601347:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714098048 00000100:00100000:1.0:1787364931.601354:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714098048 00000100:00100000:1.0:1787364931.601409:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787364931.601418:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1874187714098048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364931.601471:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1874187714098048:12345-0@lo:400:kworker.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364931.601478:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787364931.601501:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787364931.601520:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714098048:0@lo:400:kworker.0 00010000:00080000:2.0:1787364931.601751:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4079f800 x1874187714097792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364931.601770:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714097792:0@lo:400:kworker.0 00000100:00100000:3.0:1787364931.606448:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714097408:0@lo:400:kworker.0 00000100:00100000:3.0:1787364931.606469:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714097920:0@lo:400:kworker.0 00000100:00100000:3.0:1787364931.606544:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364931.606856:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714097920 00000100:00100000:1.0:1787364931.606864:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714097920 00000100:00100000:1.0:1787364931.606959:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787364931.606970:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714097920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787364931.607744:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364931.608464:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714097920:12345-0@lo:400:kworker.0 Request processed in 1491us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364931.608476:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787364931.616191:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714097920:0@lo:400:kworker.0 00000100:00100000:2.0:1787364932.107059:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787364932.107085:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714098176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364932.107162:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364932.107309:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714098176 00000100:00100000:0.0:1787364932.107326:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714098176 00000100:00100000:0.0:1787364932.107376:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787364932.107387:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714098176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787364932.107437:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364932.107503:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714098176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364932.107523:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787364932.107861:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbdc00 x1874187714098176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364932.107882:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714098176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364932.118930:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714098304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364932.119010:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364932.119081:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714098304 00000100:00100000:2.0:1787364932.119089:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714098304 00000100:00100000:2.0:1787364932.119134:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787364932.119142:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714098304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364932.119175:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364932.119223:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714098304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364932.119231:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787364932.119287:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714098304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364932.171982:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787364932.183318:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787364932.183418:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1787364933.198514:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364934.219268:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364934.436529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364934.436629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364934.436669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364934.436692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364934.436726:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688894848 00000100:00100000:3.0:1787364934.436734:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688894848 00000100:00100000:3.0:1787364934.436827:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688895104 00000100:00100000:1.0:1787364934.437159:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 123 00000100:00100000:1.0:1787364934.437172:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688894848:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364934.437260:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688894848:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 92us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364934.437279:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 123 00000100:00080000:1.0:1787364934.437409:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364934.438032:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688895104 00000100:00100000:3.0:1787364934.438097:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 124 00000100:00100000:3.0:1787364934.438106:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688895104:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364934.438156:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688895104:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 51us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364934.438162:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 124 00000100:00100000:0.0:1787364934.439012:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688894976 00000100:00100000:0.0:1787364934.439020:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688894976 00000100:00100000:0.0:1787364934.439065:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 70 00000100:00100000:0.0:1787364934.439075:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688894976:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364934.439118:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688894976:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 44us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364934.439126:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 70 00000100:00080000:1.0:1787364934.440740:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364934.440750:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364934.443014:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688894720 00000100:00100000:2.0:1787364934.443028:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688894720 00000100:00100000:2.0:1787364934.443099:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 284 00000100:00100000:2.0:1787364934.443112:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688894720:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364934.443558:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688894720:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 448us (7039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364934.443567:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 284 00010000:00010000:0.0:1787364935.242991:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364936.266986:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364936.715825:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714098688:0@lo:400:kworker.0 00000100:00100000:2.0:1787364936.715918:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364936.715991:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364936.715997:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714098816:0@lo:400:kworker.0 00000100:00100000:2.0:1787364936.716024:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364936.716228:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714098432:0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716265:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364936.716296:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714098944:0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716320:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364936.716338:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787364936.716344:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714098560:0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364936.716384:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714099072:0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716419:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364936.716449:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714098688 00000100:00100000:3.0:1787364936.716455:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714098688 00000100:00100000:3.0:1787364936.716505:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714098944 00000100:00100000:3.0:1787364936.716508:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714098944 00000100:00100000:3.0:1787364936.716522:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714098560 00000100:00100000:3.0:1787364936.716525:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714098560 00000100:00100000:3.0:1787364936.716539:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787364936.716546:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714098688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716599:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714098688:12345-0@lo:400:kworker.0 Request processed in 53us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364936.716606:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787364936.716638:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787364936.716644:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714098944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716680:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714098944:12345-0@lo:400:kworker.0 Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364936.716686:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787364936.716697:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787364936.716703:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716728:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714098560:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364936.716734:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787364936.716771:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714098560:0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716782:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714098944:0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.716839:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714098688:0@lo:400:kworker.0 00000100:00100000:2.0:1787364936.717086:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714098432 00000100:00100000:2.0:1787364936.717091:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714098432 00000100:00100000:2.0:1787364936.717131:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787364936.717139:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714098432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364936.717178:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714098432:12345-0@lo:400:kworker.0 Request processed in 40us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364936.717184:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787364936.717295:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714098816 00000100:00100000:1.0:1787364936.717299:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714098816 00000100:00100000:1.0:1787364936.717328:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714099072 00000100:00100000:1.0:1787364936.717331:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714099072 00000100:00100000:1.0:1787364936.717351:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787364936.717358:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714098816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364936.717411:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714098816:12345-0@lo:400:kworker.0 Request processed in 53us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364936.717417:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787364936.717430:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787364936.717436:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714099072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364936.717465:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714099072:12345-0@lo:400:kworker.0 Request processed in 30us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364936.717471:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787364936.717494:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364936.717498:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787364936.717500:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787364936.719233:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4079f480 x1874187714098816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364936.719250:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714098816:0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.719289:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787364936.719294:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d4079c380, transno 4294967300 00000100:00100000:3.0:1787364936.719313:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714099072:0@lo:400:kworker.0 00000100:00100000:3.0:1787364936.719324:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714098432:0@lo:400:kworker.0 00000100:00100000:2.0:1787364937.230100:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714099200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364937.230178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364937.230372:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364937.230381:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714099328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364937.230408:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364937.230445:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714099200 00000100:00100000:2.0:1787364937.230454:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714099200 00000100:00100000:2.0:1787364937.230496:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714099328 00000100:00100000:2.0:1787364937.230498:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714099328 00000100:00100000:2.0:1787364937.230514:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787364937.230523:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714099200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364937.230572:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364937.230619:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714099200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364937.230627:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787364937.230644:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787364937.230651:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714099328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787364937.230669:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364937.230695:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714099328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364937.230701:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787364937.230740:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d40d7e300 x1874187714099328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364937.230759:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40d7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714099328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364937.230774:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714099200:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787364937.293531:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364938.315687:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364939.340760:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364939.559351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364939.559396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364939.559435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364939.559474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364939.559485:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688895488 00000100:00100000:3.0:1787364939.559496:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688895488 00000100:00100000:1.0:1787364939.559499:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688895360 00000100:00100000:1.0:1787364939.559514:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688895360 00000100:00100000:3.0:1787364939.559556:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 73 00000100:00100000:3.0:1787364939.559575:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688895488:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364939.559650:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688895488:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364939.559655:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688895232 00000100:00100000:3.0:1787364939.559658:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 73 00000100:00100000:2.0:1787364939.559659:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688895232 00000100:00100000:2.0:1787364939.559684:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 286 00000100:00100000:2.0:1787364939.559690:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688895232:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364939.559716:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688895232:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364939.559722:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 286 00000100:00080000:2.0:1787364939.559777:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787364939.559781:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787364939.559832:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688895616 00000100:00100000:3.0:1787364939.559835:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688895616 00000100:00080000:2.0:1787364939.559871:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364939.559878:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 128 00000100:00100000:3.0:1787364939.559885:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688895360:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364939.559930:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688895360:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 45us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364939.559936:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 128 00000100:00100000:3.0:1787364939.559950:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 129 00000100:00100000:3.0:1787364939.559956:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688895616:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364939.559979:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688895616:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 24us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364939.559992:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 129 00000040:00080000:0.0:1787364940.043610:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787364940.363274:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364941.387609:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364941.835518:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714099840:0@lo:400:kworker.0 00000100:00100000:2.0:1787364941.835602:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714099712:0@lo:400:kworker.0 00000100:00100000:2.0:1787364941.835683:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364941.835951:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714099456:0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.835990:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364941.836021:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714099968:0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836043:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364941.836062:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787364941.836067:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714099584:0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836087:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364941.836100:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714100096:0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836136:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364941.836167:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714099712 00000100:00100000:3.0:1787364941.836174:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714099712 00000100:00100000:3.0:1787364941.836222:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714099968 00000100:00100000:3.0:1787364941.836225:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714099968 00000100:00100000:3.0:1787364941.836238:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714099584 00000100:00100000:3.0:1787364941.836240:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714099584 00000100:00100000:3.0:1787364941.836255:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787364941.836263:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714099712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836314:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714099712:12345-0@lo:400:kworker.0 Request processed in 52us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364941.836321:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787364941.836338:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787364941.836345:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714099968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836376:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714099968:12345-0@lo:400:kworker.0 Request processed in 32us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364941.836382:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787364941.836395:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787364941.836400:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714099584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836425:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714099584:12345-0@lo:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364941.836431:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787364941.836446:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364941.836478:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714099712:0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836514:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714099584:0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836537:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714099968:0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836582:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714100096 00000100:00100000:3.0:1787364941.836586:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714100096 00000100:00100000:3.0:1787364941.836620:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787364941.836627:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714100096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.836664:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714100096:12345-0@lo:400:kworker.0 Request processed in 38us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364941.836670:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787364941.836682:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787364941.836695:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714100096:0@lo:400:kworker.0 00000100:00100000:2.0:1787364941.837080:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714099456 00000100:00100000:2.0:1787364941.837085:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714099456 00000100:00100000:2.0:1787364941.837123:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787364941.837131:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714099456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364941.837172:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714099456:12345-0@lo:400:kworker.0 Request processed in 43us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364941.837179:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787364941.837295:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714099456:0@lo:400:kworker.0 00000100:00100000:0.0:1787364941.837417:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364941.837642:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714099840 00000100:00100000:3.0:1787364941.837647:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714099840 00000100:00100000:3.0:1787364941.837755:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787364941.837763:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714099840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364941.837834:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714099840:12345-0@lo:400:kworker.0 Request processed in 72us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364941.837840:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1787364941.837899:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d2ffbc000 x1874187714099840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364941.837911:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714099840:0@lo:400:kworker.0 00000100:00080000:0.0:1787364941.838058:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364942.347323:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714100224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364942.347398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364942.347531:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714100224 00000100:00100000:3.0:1787364942.347541:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714100224 00000100:00100000:3.0:1787364942.347598:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787364942.347608:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714100224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364942.347645:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364942.347691:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714100224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364942.347699:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787364942.347862:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d40d7df80 x1874187714100224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364942.347883:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714100224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364942.348395:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364942.348406:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714100352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364942.348447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364942.349510:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714100352 00000100:00100000:3.0:1787364942.349536:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714100352 00000100:00100000:3.0:1787364942.349594:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787364942.349604:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714100352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364942.349640:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364942.349700:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714100352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364942.349708:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787364942.349941:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714100352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364942.411000:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364943.437275:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364944.465878:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364944.679859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364944.679912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364944.679993:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688895744 00000100:00100000:0.0:1787364944.680002:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688895744 00000100:00100000:0.0:1787364944.680057:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 288 00000100:00100000:0.0:1787364944.680066:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688895744:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364944.680141:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688895744:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 75us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364944.680149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 288 00000100:00100000:3.0:1787364944.680220:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688895872 00000100:00100000:3.0:1787364944.680224:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688895872 00000100:00100000:3.0:1787364944.680269:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 133 00000100:00100000:3.0:1787364944.680276:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688895872:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364944.680306:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688895872:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364944.680312:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 133 00000100:00080000:0.0:1787364944.680631:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364944.694890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364944.694959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364944.695055:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688896000 00000100:00100000:0.0:1787364944.695065:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688896000 00000100:00100000:0.0:1787364944.695139:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:0.0:1787364944.695161:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2363:x1874187688896000:12345-192.168.204.2@tcp:9:kworker.0 00000020:00000080:0.0:1787364944.695192:0:8229:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2b02b 00000100:00080000:0.0:1787364944.695200:0:8229:0:(import.c:65:import_set_state_nolock()) ffff9b6d055e1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787364944.695235:0:8229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787364944.695519:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+2:2363:x1874187688896000:12345-192.168.204.2@tcp:9:kworker.0 Request processed in 359us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364944.695528:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00010000:00010000:2.0:1787364944.695651:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364944.695941:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688896128 00000100:00100000:1.0:1787364944.695946:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688896128 00000100:00100000:1.0:1787364944.695991:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 134 00000100:00100000:1.0:1787364944.695999:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688896128:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364944.696045:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688896128:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 47us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364944.696052:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 134 00000100:00080000:3.0:1787364944.696528:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787364944.696534:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787364945.483118:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364946.507215:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364946.960843:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714100608:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.960912:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364946.960976:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3c7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714101120:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.961000:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364946.961045:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787364946.961052:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714100480:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.961080:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364946.961102:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3c7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714100992:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.961123:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364946.963888:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714100480 00000100:00100000:0.0:1787364946.963903:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714100480 00000100:00100000:0.0:1787364946.963970:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787364946.963979:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714100480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964071:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d06255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3316:x1874187714100480:12345-0@lo:400:kworker.0 Request processed in 93us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364946.964078:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787364946.964117:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714100608 00000100:00100000:0.0:1787364946.964121:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714100608 00000100:00100000:0.0:1787364946.964146:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714100992 00000100:00100000:0.0:1787364946.964161:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714100992 00000100:00100000:0.0:1787364946.964189:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787364946.964195:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714100608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964227:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714100608:12345-0@lo:400:kworker.0 Request processed in 32us (3315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364946.964232:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787364946.964243:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787364946.964248:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714100992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964269:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714100992:12345-0@lo:400:kworker.0 Request processed in 21us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364946.964274:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787364946.964314:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8853f36b-eb15-4321-aed5-724dfa11fdc2:3316:1874187714100480:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964327:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3c7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714100992:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964337:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714100608:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964372:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714100736:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964412:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364946.964435:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364946.964441:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3c7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714100864:0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964463:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364946.964483:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714100736 00000100:00100000:0.0:1787364946.964486:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714100736 00000100:00100000:0.0:1787364946.964506:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787364946.964510:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714100736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964537:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714100736:12345-0@lo:400:kworker.0 Request processed in 27us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364946.964563:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787364946.964587:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714100736:0@lo:400:kworker.0 00000100:00080000:0.0:1787364946.964617:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364946.964634:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714101120 00000100:00100000:0.0:1787364946.964637:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714101120 00000100:00100000:0.0:1787364946.964673:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714100864 00000100:00100000:0.0:1787364946.964676:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714100864 00000100:00100000:0.0:1787364946.964699:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787364946.964705:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714101120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964743:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714101120:12345-0@lo:400:kworker.0 Request processed in 38us (3742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364946.964748:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787364946.964759:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787364946.964764:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714100864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364946.964818:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714100864:12345-0@lo:400:kworker.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364946.964824:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787364946.964836:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787364946.964839:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787364946.964856:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3c7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714101120:0@lo:400:kworker.0 00010000:00080000:0.0:1787364946.964876:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3c7ab480 x1874187714100864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364946.964886:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3c7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714100864:0@lo:400:kworker.0 00000100:00100000:0.0:1787364947.467064:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714101248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364947.467141:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364947.467231:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787364947.467238:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3c7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714101376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364947.467264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364947.467492:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714101248 00000100:00100000:3.0:1787364947.467500:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714101248 00000100:00100000:3.0:1787364947.467541:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714101376 00000100:00100000:3.0:1787364947.467544:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714101376 00000100:00100000:3.0:1787364947.467561:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787364947.467570:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714101248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364947.467603:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364947.467660:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714101248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364947.467673:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787364947.467689:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787364947.467695:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714101376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364947.467711:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364947.467738:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714101376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364947.467745:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787364947.467806:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3c7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714101376:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787364947.467820:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d40d7f480 x1874187714101248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787364947.467833:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714101248:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787364947.522667:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:3.0:1787364947.522675:0:7661:0:(genops.c:885:class_export_put()) final put ffff9b6c06b0e000/6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:0.0:1787364947.522807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c06b0e000/6b97b2b3-6991-434b-88a0-aee779536483 for lustre-OST0001 00000020:00000080:0.0:1787364947.522867:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d055e1000 for lustre-OST0001 00010000:00010000:1.0:1787364947.530946:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364948.560217:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364949.581753:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364949.790535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364949.790574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364949.790613:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364949.790645:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688896256 00000100:00100000:3.0:1787364949.790653:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688896256 00000100:00100000:3.0:1787364949.790693:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 290 00000100:00100000:3.0:1787364949.790710:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688896256:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364949.790778:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688896256:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364949.790806:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 290 00000100:00100000:0.0:1787364949.791310:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688896384 00000100:00100000:0.0:1787364949.791315:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688896384 00000100:00100000:0.0:1787364949.791402:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688896512 00000100:00100000:0.0:1787364949.791406:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688896512 00000100:00080000:3.0:1787364949.791433:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364949.791559:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 138 00000100:00100000:0.0:1787364949.791569:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2364:x1874187688896384:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364949.791636:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2364:x1874187688896384:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 69us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364949.791644:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 138 00000100:00100000:0.0:1787364949.791658:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 139 00000100:00100000:0.0:1787364949.791664:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688896512:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364949.791686:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688896512:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 23us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364949.791692:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 139 00000040:00080000:0.0:1787364950.285428:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787364950.603739:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364951.627122:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364952.078060:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714101760:0@lo:400:kworker.0 00000100:00100000:1.0:1787364952.078140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364952.078269:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714101632:0@lo:400:kworker.0 00000100:00100000:2.0:1787364952.078301:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364952.078363:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714101504:0@lo:400:kworker.0 00000100:00100000:0.0:1787364952.078394:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364952.078456:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714101760 00000100:00100000:0.0:1787364952.078463:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714101760 00000100:00100000:0.0:1787364952.078509:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714101632 00000100:00100000:0.0:1787364952.078512:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714101632 00000100:00100000:0.0:1787364952.078528:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787364952.078541:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714101760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364952.078598:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714101760:12345-0@lo:400:kworker.0 Request processed in 58us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364952.078607:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787364952.078629:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787364952.078637:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714101632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364952.078653:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714101760:0@lo:400:kworker.0 00000100:00100000:0.0:1787364952.078663:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714101632:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364952.078670:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787364952.078676:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364952.078685:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714101888:0@lo:400:kworker.0 00000100:00080000:0.0:1787364952.078687:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364952.078716:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364952.078782:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714101632:0@lo:400:kworker.0 00000100:00100000:1.0:1787364952.079674:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714102144:0@lo:400:kworker.0 00000100:00100000:1.0:1787364952.079736:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364952.079924:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714101888 00000100:00100000:0.0:1787364952.079930:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714101888 00000100:00100000:0.0:1787364952.079977:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714102144 00000100:00100000:0.0:1787364952.079980:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714102144 00000100:00100000:0.0:1787364952.080002:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787364952.080011:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714101888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364952.080064:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714101888:12345-0@lo:400:kworker.0 Request processed in 54us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364952.080071:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787364952.080085:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787364952.080092:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714102144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364952.080120:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714102144:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364952.080126:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787364952.080145:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787364952.080147:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787364952.080170:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d07d45880 x1874187714101888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787364952.080191:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714101888:0@lo:400:kworker.0 00000100:00100000:2.0:1787364952.080300:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714101504 00000100:00100000:2.0:1787364952.080305:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714101504 00000100:00100000:2.0:1787364952.080345:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787364952.080352:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714101504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364952.080387:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714101504:12345-0@lo:400:kworker.0 Request processed in 36us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364952.080393:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787364952.080623:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714102144:0@lo:400:kworker.0 00000100:00100000:3.0:1787364952.080671:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714101504:0@lo:400:kworker.0 00000100:00100000:3.0:1787364952.080681:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714102016:0@lo:400:kworker.0 00000100:00100000:3.0:1787364952.080716:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364952.081051:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714102016 00000100:00100000:1.0:1787364952.081057:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714102016 00000100:00100000:1.0:1787364952.081109:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787364952.081117:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714102016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364952.081169:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714102016:12345-0@lo:400:kworker.0 Request processed in 52us (451us total) trans 0 rc 0/0 00000100:00080000:0.0:1787364952.081622:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364952.081916:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787364952.081961:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714102016:0@lo:400:kworker.0 00000001:02000400:1.0:1787364952.419374:0:11867:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:15:50 (1787364950) 00000100:00100000:2.0:1787364952.587691:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787364952.587715:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364952.587820:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364952.588333:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364952.588347:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3c7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714102400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364952.588383:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364952.588492:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714102272 00000100:00100000:0.0:1787364952.588500:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714102272 00000100:00100000:0.0:1787364952.588560:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714102400 00000100:00100000:0.0:1787364952.588563:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714102400 00000100:00100000:0.0:1787364952.588582:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787364952.588591:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714102272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787364952.588626:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364952.588671:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714102272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364952.588678:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787364952.588697:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787364952.588704:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714102400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787364952.588721:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364952.588753:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714102400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364952.588758:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787364952.589395:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714102272:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787364952.601674:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d3c7a8e00 x1874187714102400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787364968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364952.601711:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3c7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714102400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787364952.650920:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364953.675555:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364954.701217:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364954.734291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364954.734472:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688896640 00000100:00100000:0.0:1787364954.734501:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688896640 00000100:00100000:0.0:1787364954.734578:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00100000:0.0:1787364954.734589:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:10244:x1874187688896640:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364954.734611:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364954.734672:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b0f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db50 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.734760:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b0fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.734775:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.734826:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364954.735035:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787364954.735039:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787364954.735130:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.735156:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b0f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db50 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.735172:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b0fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db50 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.735180:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:0.0:1787364954.735183:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787364954.735187:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5200, rc 0) 00000100:00100000:0.0:1787364954.735255:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:10244:x1874187688896640:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 668us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364954.735263:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00080000:2.0:1787364954.735831:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364954.755983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364954.756145:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688896768 00000100:00100000:2.0:1787364954.756155:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688896768 00000100:00100000:2.0:1787364954.756219:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:2.0:1787364954.756232:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:10245:x1874187688896768:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364954.756253:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364954.756275:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db57 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756347:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756361:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756372:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756387:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756395:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756401:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756861:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35400/0xcfc9272e5fc2b119 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756884:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35400/0xcfc9272e5fc2b119 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.756892:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35400/0xcfc9272e5fc2b119 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364954.756976:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787364954.756980:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364954.757055:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35400/0xcfc9272e5fc2b119 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757068:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757074:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757080:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757086:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e34e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364954.757090:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757097:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757108:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:2.0:1787364954.757115:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364954.757120:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757126:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b10b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757137:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757141:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757146:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757151:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e35200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364954.757153:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757157:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757163:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b6d104f9b00) 00010000:00010000:2.0:1787364954.757165:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364954.757167:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757172:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b112 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757201:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db57 expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757223:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35400/0xcfc9272e5fc2b119 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db57 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364954.757230:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d104f9700) 00010000:00010000:2.0:1787364954.757232:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787364954.757234:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35400, rc 0) 00000100:00100000:2.0:1787364954.757303:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:10245:x1874187688896768:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 1074us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364954.757311:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:3.0:1787364954.774007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364954.774828:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688897024 00000100:00100000:0.0:1787364954.774854:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688897024 00000100:00100000:0.0:1787364954.775089:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 34 00000100:00100000:0.0:1787364954.775101:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:10245:x1874187688897024:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364954.775123:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364954.775145:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b120 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db5e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.775222:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.775237:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.775250:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.775330:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.775339:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.775347:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777266:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2b135 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777287:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2b135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777297:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2b135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364954.777320:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787364954.777560:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777569:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777576:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777583:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364954.777588:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777595:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777609:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d104f9700) 00010000:00010000:0.0:1787364954.777612:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364954.777617:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777623:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b127 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777634:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777641:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777656:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777661:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364954.777665:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777671:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777680:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b6d3c6a8c00) 00010000:00010000:0.0:1787364954.777682:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364954.777686:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.777691:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b12e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.779722:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b120 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db5e expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.779749:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2b135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db5e expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364954.779758:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:0.0:1787364954.779761:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364954.779765:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5c00, rc 0) 00000100:00100000:0.0:1787364954.781062:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+9:10245:x1874187688897024:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 5956us (7058us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787364954.781090:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 34 00000100:00100000:3.0:1787364954.785251:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364954.785406:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688897152 00000100:00100000:2.0:1787364954.785417:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688897152 00000100:00100000:2.0:1787364954.785486:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:2.0:1787364954.785505:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:10245:x1874187688897152:12345-192.168.204.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787364954.785619:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:10245:x1874187688897152:12345-192.168.204.2@tcp:59:lhsmtool_posix.0 Request processed in 116us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364954.785628:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:2.0:1787364954.908372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364954.908450:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364954.908614:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688897280 00000100:00100000:0.0:1787364954.908626:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688897280 00000100:00100000:0.0:1787364954.908690:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 292 00000100:00100000:0.0:1787364954.908702:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2366:x1874187688897280:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364954.908823:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2366:x1874187688897280:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 123us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364954.908832:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 292 00000100:00100000:1.0:1787364954.909372:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688897408 00000100:00100000:1.0:1787364954.909378:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688897408 00000100:00100000:1.0:1787364954.909452:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 143 00000100:00100000:1.0:1787364954.909461:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688897408:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364954.909526:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688897408:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 66us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364954.909533:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 143 00000100:00080000:0.0:1787364954.910270:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787364955.403934:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787364955.727374:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364956.746990:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364957.195333:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714102528:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.195441:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364957.195539:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714103040:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.195582:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364957.195616:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787364957.195623:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714102656:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.195645:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364957.195661:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714103168:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.195684:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364957.195716:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714102784:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.195739:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364957.195757:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364957.195763:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714102912:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.195817:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364957.195874:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714103040 00000100:00100000:1.0:1787364957.195881:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714103040 00000100:00100000:1.0:1787364957.195998:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714102656 00000100:00100000:1.0:1787364957.196002:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714102656 00000100:00100000:1.0:1787364957.196023:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714102784 00000100:00100000:1.0:1787364957.196026:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714102784 00000100:00100000:1.0:1787364957.196050:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787364957.196059:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714103040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.196905:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714103040:12345-0@lo:400:kworker.0 Request processed in 844us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.196915:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787364957.196936:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787364957.196944:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714102656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.196978:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714102656:12345-0@lo:400:kworker.0 Request processed in 36us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.196984:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787364957.197017:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787364957.197024:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714102784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.197058:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714102784:12345-0@lo:400:kworker.0 Request processed in 35us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.197064:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787364957.197740:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714103168 00000100:00100000:1.0:1787364957.197748:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714103168 00000100:00100000:1.0:1787364957.197878:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714102912 00000100:00100000:1.0:1787364957.197882:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714102912 00000100:00100000:1.0:1787364957.197911:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787364957.197919:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714103168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.197969:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714103168:12345-0@lo:400:kworker.0 Request processed in 51us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.197989:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787364957.198003:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787364957.198009:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714102912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.198041:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714102912:12345-0@lo:400:kworker.0 Request processed in 32us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.198046:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787364957.198075:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787364957.198079:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364957.198082:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787364957.199015:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d409d4000 x1874187714102912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787364973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787364957.199032:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714102912:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.199048:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714102784:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.199164:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714102656:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.199194:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714103168:0@lo:400:kworker.0 00000100:00100000:1.0:1787364957.199208:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714103040:0@lo:400:kworker.0 00000100:00100000:0.0:1787364957.203522:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714102528 00000100:00100000:0.0:1787364957.204927:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714102528 00000100:00100000:0.0:1787364957.205021:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787364957.205035:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714102528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364957.205143:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714102528:12345-0@lo:400:kworker.0 Request processed in 111us (9701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364957.205150:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787364957.205214:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714102528:0@lo:400:kworker.0 00000100:00100000:0.0:1787364957.279404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.279552:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688897536 00000100:00100000:1.0:1787364957.279565:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688897536 00000100:00100000:1.0:1787364957.279644:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 36 00000100:00100000:1.0:1787364957.279655:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:10288:x1874187688897536:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364957.279674:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364957.279693:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db65 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.279813:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.279828:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.279841:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.279856:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.279863:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.279871:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280115:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280123:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280129:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280134:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364957.280139:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280156:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280169:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:1.0:1787364957.280173:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364957.280178:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280183:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280197:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280203:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280209:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280214:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364957.280216:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280221:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280228:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b6d12906500) 00010000:00010000:1.0:1787364957.280231:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364957.280233:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280248:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280288:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b143 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db65 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280298:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:1.0:1787364957.280301:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364957.280305:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db65 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.280315:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1e00, rc 0) 00000100:00100000:1.0:1787364957.280390:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:10288:x1874187688897536:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 737us (996us total) trans 0 rc 301/301 00000100:00100000:1.0:1787364957.280397:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 36 00000100:00080000:0.0:1787364957.281147:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364957.292977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.293047:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688897792 00000100:00100000:1.0:1787364957.293058:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688897792 00000100:00100000:1.0:1787364957.293124:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:1.0:1787364957.293134:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+9:10288:x1874187688897792:12345-192.168.204.2@tcp:36:lfs.0 00010000:00010000:1.0:1787364957.293192:0:8228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364957.293220:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b0fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db50 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.293237:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:1.0:1787364957.293247:0:8228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364957.293535:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.293554:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.293565:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.293579:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.293586:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.293593:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364957.297414:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787364957.297434:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.297459:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.297467:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.297473:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364957.297477:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.297486:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.297514:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:1.0:1787364957.297517:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364957.297523:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.297529:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b158 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787364957.297550:0:8228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2543a19 reply state 00000000e481a15a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364957.297559:0:8228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364957.297687:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+10:10288:x1874187688897792:12345-192.168.204.2@tcp:36:lfs.0 Request processed in 4550us (4715us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787364957.297695:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 37 00010000:00010000:0.0:1787364957.306927:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.306946:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.308660:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.308668:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364957.308673:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.308683:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.308716:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b6d12906200) 00010000:00010000:0.0:1787364957.308720:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364957.308726:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.308733:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b15f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364957.396568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364957.396609:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688897920 00000100:00100000:0.0:1787364957.396630:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688897920 00000100:00100000:0.0:1787364957.396682:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 38 00000100:00100000:0.0:1787364957.396693:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:10296:x1874187688897920:12345-192.168.204.2@tcp:101:lctl.0 00010000:00010000:0.0:1787364957.396719:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364957.396741:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b166 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db6c expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.396830:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b16d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.396855:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b16d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.396879:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b16d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364957.396947:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787364957.396951:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787364957.396995:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b16d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.397020:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b166 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db6c expref: 11 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.397036:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b16d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db6c expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.397045:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:0.0:1787364957.397048:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787364957.397051:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4a00, rc 0) 00000100:00100000:0.0:1787364957.397106:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+10:10296:x1874187688897920:12345-192.168.204.2@tcp:101:lctl.0 Request processed in 415us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364957.397114:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 38 00000100:00100000:1.0:1787364957.502223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364957.502334:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688898048 00000100:00100000:3.0:1787364957.502344:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688898048 00000100:00100000:3.0:1787364957.502452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:3.0:1787364957.502464:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+10:10302:x1874187688898048:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364957.502486:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364957.502572:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db73 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.502718:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.502733:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.502743:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.502758:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.502764:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.502956:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503145:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503155:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503162:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364957.503200:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787364957.503204:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364957.503240:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503250:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503256:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503261:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503266:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364957.503270:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503277:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503287:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:2.0:1787364957.503290:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364957.503293:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503298:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b17b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503311:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503325:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503331:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503336:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364957.503338:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503345:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503352:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b6d10b29600) 00010000:00010000:2.0:1787364957.503354:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364957.503357:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503363:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b182 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503399:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db73 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503415:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db73 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.503423:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787364957.503425:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787364957.503433:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35a00, rc 0) 00000100:00100000:2.0:1787364957.503629:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+11:10302:x1874187688898048:12345-192.168.204.2@tcp:101:bash.0 Request processed in 1166us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364957.503638:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:0.0:1787364957.508232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.508342:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688898304 00000100:00100000:1.0:1787364957.508354:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688898304 00000100:00100000:1.0:1787364957.508526:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 40 00000100:00100000:1.0:1787364957.508538:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+11:10302:x1874187688898304:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:1.0:1787364957.508564:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364957.508585:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b190 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db7a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.508973:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.508991:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.509018:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.509055:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.509062:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.509069:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787364957.510016:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787364957.510196:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510209:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510219:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510253:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510259:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510266:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510271:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364957.510282:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510289:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510300:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364957.510303:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364957.510308:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510314:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b197 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787364957.510329:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002eb7e728 reply state 00000000728685a9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364957.510337:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787364957.510371:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b190 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510386:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.510394:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906f00) 00010000:00010000:1.0:1787364957.510396:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364957.510399:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0600, rc 0) 00000100:00100000:1.0:1787364957.512454:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:10302:x1874187688898304:12345-192.168.204.2@tcp:101:bash.0 Request processed in 3897us (4209us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787364957.512469:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 40 00010000:00010000:1.0:1787364957.517028:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.517045:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.517052:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.517059:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364957.517063:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.517070:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.517087:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d12906500) 00010000:00010000:1.0:1787364957.517090:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364957.517095:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.517101:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b19e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364957.520827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.521165:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688898432 00000100:00100000:1.0:1787364957.521177:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688898432 00000100:00100000:1.0:1787364957.521228:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:1.0:1787364957.521237:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1874187688898432:12345-192.168.204.2@tcp:8:bash.0 00010000:00080000:1.0:1787364957.521274:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:1.0:1787364957.521305:0:6710:0:(genops.c:1385:class_connect()) connect: client 6b97b2b3-6991-434b-88a0-aee779536483, cookie 0xcfc9272e5fc2b1b3 00002000:00100000:1.0:1787364957.521318:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6b97b2b3-6991-434b-88a0-aee779536483/ffff9b6d02c4f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787364957.521355:0:6710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787364957.522067:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787364957.522142:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9b6d02c4b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787364957.522215:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2363:x1874187688898432:12345-192.168.204.2@tcp:8:bash.0 Request processed in 978us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.522225:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:3.0:1787364957.524892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.525052:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688898560 00000100:00100000:1.0:1787364957.525061:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688898560 00000100:00100000:1.0:1787364957.525140:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:1.0:1787364957.525150:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:0:x1874187688898560:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:1.0:1787364957.525168:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364957.525194:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db81 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787364957.525220:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787364957.525240:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1787364957.525245:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364957.525256:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.525276:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.525290:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1c00, rc 0) 00000100:00100000:1.0:1787364957.525369:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:0:x1874187688898560:12345-192.168.204.2@tcp:101:bash.0 Request processed in 221us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.525406:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00080000:0.0:1787364957.526257:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787364957.530967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.531061:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688898688 00000100:00100000:1.0:1787364957.531071:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688898688 00000100:00100000:1.0:1787364957.531132:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:1.0:1787364957.531144:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:10302:x1874187688898688:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:1.0:1787364957.531162:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364957.531181:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db88 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.531211:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.531220:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364957.531224:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364957.531230:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.531262:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.531277:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 8 pid: 6707 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364957.531292:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6709:1874187714103296:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364957.531390:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787364957.543434:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6709:1874187714103296:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364957.543484:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.543506:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0400, rc 0) 00000100:00100000:1.0:1787364957.543576:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:10302:x1874187688898688:12345-192.168.204.2@tcp:101:bash.0 Request processed in 12434us (12618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.544212:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:2.0:1787364957.546769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364957.546877:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688898816 00000100:00100000:3.0:1787364957.546887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688898816 00010000:00010000:3.0:1787364957.546931:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 8 pid: 6707 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364957.546974:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:3.0:1787364957.546985:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688898816:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364957.547001:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364957.547026:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 8 pid: 6707 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.547039:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 8 pid: 6707 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.547073:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b1ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db81 expref: 8 pid: 6707 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.547093:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364957.547097:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364957.547106:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.547135:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.547174:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364957.547190:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874187714103424:192.168.204.2@tcp:105: 00000100:00100000:3.0:1787364957.547287:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787364957.554556:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874187714103424:192.168.204.2@tcp:105: 00010000:00010000:3.0:1787364957.554599:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364957.554668:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688898816:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 7683us (7906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364957.554680:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:0.0:1787364957.564293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364957.565017:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688899072 00000100:00100000:3.0:1787364957.565030:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688899072 00000100:00100000:3.0:1787364957.565091:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:3.0:1787364957.565102:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+13:10302:x1874187688899072:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:3.0:1787364957.565510:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:10302:x1874187688899072:12345-192.168.204.2@tcp:35:bash.0 Request processed in 408us (1233us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787364957.565518:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:1.0:1787364957.707677:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3c7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714103552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364957.708119:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364957.709875:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714103680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364957.709932:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364957.718255:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714103552 00000100:00100000:3.0:1787364957.718270:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714103552 00000100:00100000:3.0:1787364957.718327:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714103680 00000100:00100000:3.0:1787364957.718331:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714103680 00000100:00100000:3.0:1787364957.718365:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787364957.718376:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714103552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364957.718402:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364957.718492:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714103552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (10372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364957.718502:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787364957.718526:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787364957.718534:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714103680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364957.718556:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364957.718663:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714103680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (8730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364957.718670:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787364957.718816:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3c7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714103552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364957.718884:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714103680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364957.738286:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.738327:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688899328 00000100:00100000:1.0:1787364957.738337:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688899328 00000100:00100000:1.0:1787364957.738392:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:1.0:1787364957.738403:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+14:10312:x1874187688899328:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364957.738425:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364957.738456:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b1c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db8f expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364957.738712:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787364957.739318:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b1c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db8f expref: 16 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.739335:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:1.0:1787364957.739337:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787364957.739342:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b1c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db8f expref: 16 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.739367:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1e00, rc 0) 00000100:00100000:1.0:1787364957.739426:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+15:10312:x1874187688899328:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1025us (1150us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787364957.739446:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:3.0:1787364957.744906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364957.748864:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688899584 00000100:00100000:2.0:1787364957.748881:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688899584 00000100:00100000:3.0:1787364957.749173:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:3.0:1787364957.749185:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+15:10312:x1874187688899584:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:3.0:1787364957.749698:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+16:10312:x1874187688899584:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 513us (4800us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787364957.749708:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00010000:00010000:0.0:1787364957.772053:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787364957.807407:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000001:00080000:1.0:1787364957.807445:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00000001:00080000:1.0:1787364957.807454:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000100:00100000:3.0:1787364957.822183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364957.822367:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688899712 00000100:00100000:2.0:1787364957.822377:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688899712 00000100:00100000:2.0:1787364957.822470:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:2.0:1787364957.822481:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+12:10318:x1874187688899712:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364957.822505:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364957.822529:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b1d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db96 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.822602:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b1dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.822615:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b1dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.822629:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b1dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364957.822885:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787364957.822890:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364957.822971:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b1dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.823012:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b1d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db96 expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.823029:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b1dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db96 expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.823037:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787364957.823041:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787364957.823044:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e35000, rc 0) 00000100:00100000:2.0:1787364957.823124:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+13:10318:x1874187688899712:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 645us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364957.823131:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:2.0:1787364957.835008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364957.835100:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688899968 00000100:00100000:0.0:1787364957.835109:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688899968 00000100:00100000:0.0:1787364957.835162:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:0.0:1787364957.835171:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+13:10318:x1874187688899968:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787364957.835189:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364957.835208:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b1e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67db9d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.835304:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b1eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.835319:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b1eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.835331:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b1eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364957.835342:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787364957.835495:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b1e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db9d expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.835512:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b1eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db9d expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.835520:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906f00) 00010000:00010000:0.0:1787364957.835524:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364957.835527:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4600, rc 0) 00000100:00100000:0.0:1787364957.835586:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+15:10318:x1874187688899968:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 416us (586us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787364957.835608:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:3.0:1787364957.840395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364957.840460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364957.840539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688900352 00000100:00100000:0.0:1787364957.840549:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688900352 00000100:00100000:0.0:1787364957.840618:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:0.0:1787364957.840628:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+15:2366:x1874187688900352:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364957.840644:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364957.840670:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b1eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db9d expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.840688:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906f00) 00010000:00010000:0.0:1787364957.840693:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364957.840770:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+14:2366:x1874187688900352:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 143us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364957.840777:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:1.0:1787364957.840862:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688900224 00000100:00100000:1.0:1787364957.840867:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688900224 00000100:00100000:1.0:1787364957.840905:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:1.0:1787364957.840913:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:10318:x1874187688900224:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364957.840933:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364957.840949:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b1f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dba4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.841054:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b200 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.841070:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.841081:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364957.841093:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787364957.841217:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b1f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dba4 expref: 17 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.841253:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dba4 expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.841261:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906f00) 00010000:00010000:1.0:1787364957.841264:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787364957.841266:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1800, rc 0) 00000100:00100000:1.0:1787364957.841293:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+16:10318:x1874187688900224:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 381us (920us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787364957.841300:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:3.0:1787364957.852548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.852690:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688900480 00000100:00100000:1.0:1787364957.852711:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688900480 00000100:00100000:1.0:1787364957.852772:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:1.0:1787364957.852819:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688900480:12345-192.168.204.2@tcp:1:lfs.0 00010000:00010000:1.0:1787364957.852870:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.852891:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.852900:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787364957.852904:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364957.852908:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.852945:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.852971:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 7 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364957.852987:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6707:1874187714103808:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364957.853080:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364957.857097:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364957.857222:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688900608 00000100:00100000:0.0:1787364957.857231:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688900608 00002000:00100000:0.0:1787364957.857277:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b6d3f9f7b80 x1874187688900608/t0(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:618/0 lens 504/0 e 0 to 0 dl 1787364968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787364957.857288:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d3f9f7b80 with x1874187688900608 ext(0->12) 00010000:00010000:0.0:1787364957.857297:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 8 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.857314:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 8 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787364957.857321:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d3f9f7b80 00000100:00100000:0.0:1787364957.857370:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:0.0:1787364957.857380:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688900608:12345-192.168.204.2@tcp:4:lfs.0 00000100:00100000:1.0:1787364957.857889:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6707:1874187714103808:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364957.857912:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1787364957.890855:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000100:00100000:0.0:1787364957.897274:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+9:2367:x1874187688900608:12345-192.168.204.2@tcp:4:lfs.0 Request processed in 39882us (40174us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787364957.897290:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00002000:00100000:0.0:1787364957.897305:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b6d3f9f7b80 x1874187688900608/t4294967299(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:618/0 lens 504/448 e 0 to 0 dl 1787364968 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787364957.897316:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d3f9f7b80 with x1874187688900608 ext(0->12) 00010000:00010000:0.0:1787364957.897327:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 9 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364957.897348:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 9 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787364957.897355:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d3f9f7b80 00000100:00100000:3.0:1787364957.901923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364957.902003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688900736 00000100:00100000:2.0:1787364957.902013:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688900736 00010000:00010000:2.0:1787364957.902052:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 9 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364957.902184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 36 00000100:00100000:2.0:1787364957.902194:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:2367:x1874187688900736:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364957.902209:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787364957.902227:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787364957.902230:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787364956 00002000:00010000:2.0:1787364957.902233:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787364956 00002000:00010000:2.0:1787364957.902235:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787364956 00010000:00010000:2.0:1787364957.902241:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 9 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.902269:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 9 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.902294:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b70dc5e/0xcfc9272e5fc2b1c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db88 expref: 9 pid: 6709 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.902313:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787364957.902318:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787364957.902323:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.902334:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.902364:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364957.902421:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688900736:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 222us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364957.902436:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 36 00010000:00010000:1.0:1787364957.902480:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.902490:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.902515:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.902524:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.902532:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.902550:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787364957.902554:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.902564:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.902575:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.902583:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2b20e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364957.902632:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688900480:12345-192.168.204.2@tcp:1:lfs.0 Request processed in 49852us (50095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.902640:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:3.0:1787364957.905476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.905564:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688900992 00000100:00100000:1.0:1787364957.905574:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688900992 00000100:00100000:1.0:1787364957.905632:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:1.0:1787364957.905642:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+16:10318:x1874187688900992:12345-192.168.204.2@tcp:35:lfs.0 00000004:00010000:1.0:1787364957.905730:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dba4 expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787364957.906093:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787364957.906149:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787364957.906928:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787364957.906991:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.907011:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.907020:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.907055:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.907071:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 20 pid: 5857 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364957.907085:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874187714103936:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364957.907174:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787364957.910741:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874187714103936:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364957.910768:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364957.912632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364957.912971:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688901120 00000100:00100000:1.0:1787364957.912981:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688901120 00010000:00010000:1.0:1787364957.913019:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 21 pid: 5857 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364957.913051:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:1.0:1787364957.913070:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+21:2366:x1874187688901120:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364957.913101:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364957.913109:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 21 pid: 5857 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.913121:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 21 pid: 5857 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.913142:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b1a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db7a expref: 21 pid: 5857 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.913157:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906f00) 00010000:00010000:1.0:1787364957.913162:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.913171:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.913179:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364957.913213:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364957.913261:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+20:2366:x1874187688901120:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 201us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.913269:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 37 00010000:00010000:3.0:1787364957.913469:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.913477:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787364957.913599:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787364957.913851:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787364957.913972:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f9f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714104064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787364957.914371:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364957.914404:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787364957.915489:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714104064 00000100:00100000:1.0:1787364957.915499:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714104064 00000100:00100000:1.0:1787364957.915542:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787364957.915551:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714104064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787364957.915656:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714104064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364957.915673:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787364957.916021:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f9f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714104064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787364957.916695:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787364957.916807:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f9f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714104192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787364957.916854:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364957.916880:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364957.917352:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714104192 00000100:00100000:1.0:1787364957.917359:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714104192 00000100:00100000:1.0:1787364957.917399:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787364957.917413:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714104192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787364957.917620:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5859:x1874187714104192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 212us (764us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787364957.917628:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787364957.918353:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f9f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714104192:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787364957.918452:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787364957.918501:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.918511:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.918518:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.918538:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364957.918543:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.918551:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.918568:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906f00) 00010000:00010000:3.0:1787364957.918571:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787364957.918576:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364957.918582:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b215 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787364957.919327:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787364957.919670:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787364957.919683:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404148897385ns, next at 405148895017ns, rc = 0 00000001:00080000:3.0:1787364957.919691:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787364957.920185:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906f00) 00010000:00010000:3.0:1787364957.920189:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787364957.920199:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b200 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dba4 expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364957.920352:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+23:10318:x1874187688900992:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 14711us (14885us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787364957.920362:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 8 00000020:00080000:3.0:1787364957.920367:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787364957.925233:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364957.925303:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688901248 00000100:00100000:2.0:1787364957.925313:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688901248 00000100:00100000:2.0:1787364957.925372:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:2.0:1787364957.925383:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+23:10318:x1874187688901248:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364957.925408:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364957.925475:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b21c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbab expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.925558:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b21c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbab expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.925573:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b21c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbab expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364957.925593:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:2.0:1787364957.925596:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364957.925600:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40e34e00, rc 0) 00000100:00100000:2.0:1787364957.926385:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+24:10318:x1874187688901248:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 998us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364957.926394:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:3.0:1787364957.932252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364957.932407:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688901504 00000100:00100000:0.0:1787364957.932416:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688901504 00000100:00100000:0.0:1787364957.932482:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:0.0:1787364957.932492:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0631c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+24:10318:x1874187688901504:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787364957.932744:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0631c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+25:10318:x1874187688901504:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 253us (502us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787364957.932752:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:1.0:1787364958.080335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364958.080466:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688901760 00000100:00100000:0.0:1787364958.080476:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688901760 00000100:00100000:0.0:1787364958.080546:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:0.0:1787364958.080557:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+25:10328:x1874187688901760:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787364958.080605:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364958.080631:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbb2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364958.080986:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787364958.082538:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b223 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb2 expref: 27 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.082570:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:0.0:1787364958.082574:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787364958.082580:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb2 expref: 27 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.082594:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4600, rc 0) 00000100:00100000:0.0:1787364958.082689:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+26:10328:x1874187688901760:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 2133us (2650us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787364958.082700:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:3.0:1787364958.085880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364958.086518:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688901888 00000100:00100000:0.0:1787364958.086529:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688901888 00000100:00100000:0.0:1787364958.086600:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00100000:0.0:1787364958.086611:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+26:10328:x1874187688901888:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:0.0:1787364958.086690:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.086708:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.086718:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.086752:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.086760:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.086767:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087290:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087301:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087308:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787364958.087450:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087464:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087471:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087478:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087484:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364958.087488:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087502:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087515:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787364958.087518:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364958.087522:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087530:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b231 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087544:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087549:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087554:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087558:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364958.087561:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087566:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087572:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d3c6a8d00) 00010000:00010000:0.0:1787364958.087575:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364958.087577:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087591:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b238 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087606:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087610:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087615:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087619:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364958.087622:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087627:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087634:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364958.087636:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364958.087639:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.087644:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b23f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364958.087743:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+26:10328:x1874187688901888:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 1132us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364958.087753:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00100000:3.0:1787364958.091009:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364958.091185:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688902144 00000100:00100000:0.0:1787364958.091200:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688902144 00000100:00100000:0.0:1787364958.091258:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:0.0:1787364958.091268:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+26:10328:x1874187688902144:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787364958.092558:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+27:10328:x1874187688902144:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 1284us (1554us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787364958.092569:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:3.0:1787364958.141164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364958.141329:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688902400 00000100:00100000:2.0:1787364958.141340:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688902400 00000100:00100000:2.0:1787364958.141417:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:2.0:1787364958.141436:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+27:10331:x1874187688902400:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364958.141463:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364958.141484:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b246 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.141562:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.141576:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.141585:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.141614:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.141622:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.141630:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143006:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143021:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143030:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364958.143041:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787364958.143147:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143155:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143161:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143167:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e35200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364958.143172:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143190:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143203:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787364958.143206:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364958.143210:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143218:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35200/0xcfc9272e5fc2b24d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143232:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143238:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143244:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143249:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e35600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364958.143252:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143257:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143263:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d104f9c00) 00010000:00010000:2.0:1787364958.143265:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364958.143267:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143290:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35600/0xcfc9272e5fc2b254 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143341:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34800/0xcfc9272e5fc2b246 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143356:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.143363:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:2.0:1787364958.143366:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364958.143368:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28335c00, rc 0) 00000100:00100000:2.0:1787364958.143462:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+29:10331:x1874187688902400:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 2035us (2306us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787364958.143470:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:3.0:1787364958.147759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364958.147933:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688902528 00000100:00100000:2.0:1787364958.147943:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688902528 00000100:00100000:2.0:1787364958.147995:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:2.0:1787364958.148006:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+29:10331:x1874187688902528:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:2.0:1787364958.148108:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148127:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148138:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148178:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148184:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148190:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148196:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364958.148202:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148209:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148221:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:2.0:1787364958.148224:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787364958.148228:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.148236:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364958.157511:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+29:10331:x1874187688902528:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 9485us (9750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364958.157528:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:3.0:1787364958.160703:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364958.162099:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688902784 00000100:00100000:0.0:1787364958.162115:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688902784 00000100:00100000:0.0:1787364958.162189:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:0.0:1787364958.162200:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+29:10331:x1874187688902784:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787364958.162648:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+30:10331:x1874187688902784:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 449us (1954us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787364958.162657:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:3.0:1787364958.647661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364958.651386:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688903040 00000100:00100000:0.0:1787364958.651402:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688903040 00000100:00100000:0.0:1787364958.651487:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 50 00000100:00100000:0.0:1787364958.651498:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+30:10362:x1874187688903040:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:0.0:1787364958.651524:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364958.651547:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b270 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbc0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.651652:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b277 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.651667:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b277 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.651698:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b277 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364958.651711:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787364958.651908:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b270 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc0 expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.651929:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b277 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc0 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.651938:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364958.651941:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364958.651944:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4200, rc 0) 00000100:00100000:0.0:1787364958.652018:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+32:10362:x1874187688903040:12345-192.168.204.2@tcp:101:cat.0 Request processed in 521us (4370us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787364958.652026:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 50 00000100:00100000:3.0:1787364958.679983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364958.680147:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688903424 00000100:00100000:0.0:1787364958.680170:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688903424 00000100:00100000:0.0:1787364958.680247:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:0.0:1787364958.680259:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+32:10362:x1874187688903424:12345-192.168.204.2@tcp:35:cat.0 00000100:00100000:0.0:1787364958.680609:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+33:10362:x1874187688903424:12345-192.168.204.2@tcp:35:cat.0 Request processed in 352us (637us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787364958.680617:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:3.0:1787364958.681664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364958.682979:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688903168 00000100:00100000:1.0:1787364958.682992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688903168 00000100:00100000:1.0:1787364958.683069:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:1.0:1787364958.683079:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+33:2367:x1874187688903168:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364958.683106:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364958.683134:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b277 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc0 expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364958.683152:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:1.0:1787364958.683157:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364958.683230:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+32:2367:x1874187688903168:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 151us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364958.683237:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:1.0:1787364958.760961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364958.761465:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688903680 00000100:00100000:0.0:1787364958.761477:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688903680 00000100:00100000:0.0:1787364958.761590:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:0.0:1787364958.761603:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+32:10368:x1874187688903680:12345-192.168.204.2@tcp:101:dd.0 00010000:00010000:0.0:1787364958.761642:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364958.761646:0:8228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787364958.761674:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35000/0xcfc9272e5fc2b1dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db96 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.761695:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787364958.761701:0:8228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364958.761715:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b285 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbc7 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.761869:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.761883:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.761892:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.761923:0:8228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.761937:0:8228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 32 pid: 5858 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364958.761949:0:8228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3c7a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714104320:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364958.762042:0:8228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787364958.776164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364958.776238:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688903808 00000100:00100000:2.0:1787364958.776249:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688903808 00010000:00010000:2.0:1787364958.776290:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 33 pid: 5858 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364958.776353:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 38 00000100:00100000:2.0:1787364958.776363:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+33:2367:x1874187688903808:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364958.776380:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364958.776388:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 33 pid: 5858 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.776582:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 33 pid: 5858 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.776609:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:2.0:1787364958.776614:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.776624:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.776632:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.776653:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364958.776715:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+33:2367:x1874187688903808:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 353us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364958.776723:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 38 00010000:00010000:0.0:1787364958.778246:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b25b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbb9 expref: 32 pid: 5858 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364958.778285:0:8228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3c7a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714104320:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364958.778310:0:8228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.778320:0:8228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.778326:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364958.778347:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787364958.778604:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b285 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 33 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.778620:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 32 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.778629:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364958.778631:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787364958.778634:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4000, rc 0) 00000100:00100000:0.0:1787364958.778696:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+32:10368:x1874187688903680:12345-192.168.204.2@tcp:101:dd.0 Request processed in 17096us (17744us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787364958.778704:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:3.0:1787364958.786670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364958.786833:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688904064 00000100:00100000:2.0:1787364958.786844:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688904064 00000100:00100000:2.0:1787364958.786902:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 52 00000100:00100000:2.0:1787364958.786914:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+32:10368:x1874187688904064:12345-192.168.204.2@tcp:36:dd.0 00010000:00010000:2.0:1787364958.787511:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.787530:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.787543:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787364958.787600:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787364958.787631:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffa00187 reply state 0000000055dc4928 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364958.787641:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787364958.787737:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+35:10368:x1874187688904064:12345-192.168.204.2@tcp:36:dd.0 Request processed in 823us (1075us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787364958.787745:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 52 00000020:00080000:2.0:1787364958.787751:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787364958.793022:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.793041:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.793065:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.793073:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364958.793078:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.793086:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.793106:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364958.793110:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364958.793115:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364958.793133:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b29a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364958.795052:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364959.278192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364959.278342:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688904192 00000100:00100000:2.0:1787364959.278353:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688904192 00000100:00100000:2.0:1787364959.278450:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:2.0:1787364959.278461:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+34:10382:x1874187688904192:12345-192.168.204.2@tcp:101:stat.0 00010000:00010000:2.0:1787364959.278484:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364959.278506:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b2a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbce expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.278574:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.278608:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.278618:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.278633:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.278640:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.278647:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.278988:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.278999:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 35 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.279008:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.279041:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 35 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.279054:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 35 pid: 8228 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364959.279078:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714104448:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364959.279298:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0480 going to sleep for 11 seconds 00000100:00080000:0.0:1787364959.279889:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364959.284271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364959.284437:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688904448 00000100:00100000:1.0:1787364959.284448:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688904448 00000100:00100000:1.0:1787364959.284513:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:1.0:1787364959.284539:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+36:5606:x1874187688904448:12345-192.168.204.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787364959.284923:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+37:5606:x1874187688904448:12345-192.168.204.2@tcp:35:ldlm_bl.0 Request processed in 386us (659us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787364959.284932:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:2.0:1787364959.287044:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714104448:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364959.287074:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364959.290085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364959.290249:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688904576 00000100:00100000:0.0:1787364959.290258:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688904576 00010000:00010000:0.0:1787364959.290299:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 37 pid: 8228 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364959.290344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:0.0:1787364959.290355:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+37:2367:x1874187688904576:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364959.290372:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364959.290379:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 37 pid: 8228 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.290448:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 37 pid: 8228 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.290472:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b28c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbc7 expref: 37 pid: 8228 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.290489:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364959.290495:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.290504:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.290512:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.290548:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364959.290605:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+36:2367:x1874187688904576:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 251us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364959.290613:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 39 00010000:00010000:1.0:1787364959.290987:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.290996:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364959.291042:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787364959.291047:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364959.291088:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291101:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291110:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291129:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291136:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291144:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364959.291148:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291167:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291179:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364959.291181:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364959.291186:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291192:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b2a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291204:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291210:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291215:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291220:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364959.291223:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291229:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291236:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d104f9c00) 00010000:00010000:1.0:1787364959.291239:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364959.291242:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291258:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b2af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291295:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b2a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbce expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291309:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbce expref: 35 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.291317:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:1.0:1787364959.291320:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364959.291322:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449a00, rc 0) 00000100:00100000:1.0:1787364959.291350:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+35:10382:x1874187688904192:12345-192.168.204.2@tcp:101:stat.0 Request processed in 12892us (13168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364959.291358:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:3.0:1787364959.412890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364959.412967:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688904832 00000100:00100000:0.0:1787364959.412978:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688904832 00000100:00100000:0.0:1787364959.413044:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 54 00000100:00100000:0.0:1787364959.413054:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+35:10388:x1874187688904832:12345-192.168.204.2@tcp:36:truncate.0 00010000:00010000:0.0:1787364959.413119:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364959.413146:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b2b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbce expref: 35 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.413186:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364959.413193:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364959.413464:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.413552:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.413562:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787364959.413617:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787364959.413644:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060b650a1 reply state 000000006cbd764f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364959.413654:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787364959.414808:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+37:10388:x1874187688904832:12345-192.168.204.2@tcp:36:truncate.0 Request processed in 1724us (1895us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787364959.414821:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 54 00000020:00080000:0.0:1787364959.414828:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787364959.420734:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.420750:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.420756:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.420762:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364959.420767:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.420774:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.420824:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:1.0:1787364959.420826:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364959.420832:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.420837:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b2bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364959.688729:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364959.688824:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688904960 00000100:00100000:1.0:1787364959.688834:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688904960 00000100:00100000:1.0:1787364959.688898:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 55 00000100:00100000:1.0:1787364959.688908:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+36:10402:x1874187688904960:12345-192.168.204.2@tcp:101:stat.0 00010000:00010000:1.0:1787364959.688933:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364959.688954:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b2c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbd5 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689046:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689061:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689071:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689086:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689093:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689123:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689769:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689781:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689828:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364959.689868:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787364959.689872:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364959.689894:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689906:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689915:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689921:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689928:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689934:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364959.689938:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689956:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689969:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364959.689972:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364959.689977:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689983:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b2cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.689999:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690005:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690011:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690016:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364959.690018:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690023:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690031:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d12906a00) 00010000:00010000:1.0:1787364959.690033:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364959.690036:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690052:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690090:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b2c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 38 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690113:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 37 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.690121:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:1.0:1787364959.690124:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364959.690126:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1800, rc 0) 00000100:00100000:1.0:1787364959.690318:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+37:10402:x1874187688904960:12345-192.168.204.2@tcp:101:stat.0 Request processed in 1410us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364959.690327:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 55 00010000:00010000:0.0:1787364959.819337:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364959.821551:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364959.821730:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688905216 00000100:00100000:2.0:1787364959.821740:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688905216 00000100:00100000:2.0:1787364959.821849:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 56 00000100:00100000:2.0:1787364959.821860:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+37:10412:x1874187688905216:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364959.821881:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364959.821901:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b2e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbdc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364959.822154:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787364959.822313:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b2e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbdc expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.822329:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:2.0:1787364959.822332:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787364959.822337:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b2e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbdc expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.822349:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449000, rc 0) 00000100:00100000:2.0:1787364959.822428:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+38:10412:x1874187688905216:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 570us (886us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787364959.822442:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 56 00000100:00100000:3.0:1787364959.832892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364959.833004:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688905472 00000100:00100000:1.0:1787364959.833024:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688905472 00000100:00100000:1.0:1787364959.833092:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:1.0:1787364959.833280:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+38:10412:x1874187688905472:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:1.0:1787364959.834445:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+39:10412:x1874187688905472:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 1337us (1557us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787364959.834456:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:3.0:1787364959.930757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364959.931016:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688905728 00000100:00100000:2.0:1787364959.931027:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688905728 00000100:00100000:1.0:1787364959.931308:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00100000:1.0:1787364959.931320:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+39:10418:x1874187688905728:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:1.0:1787364959.931345:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364959.931400:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b2ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbe3 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.931514:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.931531:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 40 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.931542:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.931584:0:8228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 40 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.931600:0:8228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 40 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364959.931615:0:8228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714104576:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364959.931749:0:8228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364959.940620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364959.941253:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688905856 00000100:00100000:2.0:1787364959.941264:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688905856 00010000:00010000:2.0:1787364959.941314:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 41 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364959.941361:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 40 00000100:00100000:2.0:1787364959.941379:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+41:2366:x1874187688905856:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364959.941407:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364959.941414:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 41 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.941428:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 41 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.941452:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:2.0:1787364959.941457:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.941467:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.941476:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.941496:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364959.941566:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+41:2366:x1874187688905856:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 196us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364959.941574:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 40 00010000:00010000:1.0:1787364959.941769:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b2d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbd5 expref: 40 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364959.941827:0:8228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714104576:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364959.941847:0:8228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.941856:0:8228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.941874:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364959.941893:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787364959.942212:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b2ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 41 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.942229:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 40 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.942237:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:1.0:1787364959.942240:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787364959.942243:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1200, rc 0) 00000100:00100000:1.0:1787364959.942276:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+40:10418:x1874187688905728:12345-192.168.204.2@tcp:101:bash.0 Request processed in 10959us (11531us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787364959.942283:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00100000:3.0:1787364959.946958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364959.949979:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688906112 00000100:00100000:2.0:1787364959.949995:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688906112 00000100:00100000:2.0:1787364959.950089:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 58 00000100:00100000:2.0:1787364959.950112:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+40:10418:x1874187688906112:12345-192.168.204.2@tcp:36:bash.0 00010000:00010000:2.0:1787364959.950426:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.950444:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.950456:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787364959.950572:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787364959.950599:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008af45899 reply state 000000009225c542 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364959.950609:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787364959.950729:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+43:10418:x1874187688906112:12345-192.168.204.2@tcp:36:bash.0 Request processed in 630us (3782us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787364959.950737:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 58 00000020:00080000:2.0:1787364959.950742:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787364959.953315:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.953332:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.953339:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.953364:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364959.953368:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.953386:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.953412:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364959.953415:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364959.953420:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.953426:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b303 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364959.966735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364959.966823:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688906240 00000100:00100000:2.0:1787364959.966834:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688906240 00000100:00100000:2.0:1787364959.966903:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 59 00000100:00100000:2.0:1787364959.966916:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+42:10418:x1874187688906240:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:2.0:1787364959.966947:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364959.967002:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b30a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbea expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.967145:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.967161:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 43 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.967170:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.967206:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 43 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364959.967221:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 43 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364959.967235:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714104704:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364959.967339:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787364959.973318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364959.973876:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714104704:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364959.973908:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364959.973991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688906368 00000100:00100000:0.0:1787364959.973999:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688906368 00010000:00010000:0.0:1787364959.974039:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 44 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364959.974080:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:0.0:1787364959.974088:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+44:2366:x1874187688906368:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364959.974112:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364959.974119:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 44 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.974130:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 44 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.974169:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b2f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbe3 expref: 44 pid: 8228 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.974185:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364959.974190:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.974198:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.974205:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364959.974315:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364959.974383:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+43:2366:x1874187688906368:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 283us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364959.974398:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 41 00010000:00010000:1.0:1787364959.976909:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.976928:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364959.976982:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787364959.976986:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364959.977007:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.977051:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b30a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbea expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.977091:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbea expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364959.977113:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:1.0:1787364959.977117:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364959.977120:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449c00, rc 0) 00000100:00100000:1.0:1787364959.977601:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+42:10418:x1874187688906240:12345-192.168.204.2@tcp:101:bash.0 Request processed in 10684us (10876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364959.977610:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 59 00000100:00100000:3.0:1787364959.989459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364959.990067:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688906624 00000100:00100000:0.0:1787364959.990078:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688906624 00000100:00100000:0.0:1787364959.990152:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:0.0:1787364959.990162:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0631d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+42:10418:x1874187688906624:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:0.0:1787364959.990453:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0631d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+43:10418:x1874187688906624:12345-192.168.204.2@tcp:35:bash.0 Request processed in 291us (1002us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787364959.990461:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:3.0:1787364960.029093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364960.029191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364960.029341:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688907008 00000100:00100000:0.0:1787364960.029352:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688907008 00000100:00100000:0.0:1787364960.029439:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 147 00000100:00100000:0.0:1787364960.029463:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2365:x1874187688907008:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364960.029536:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2365:x1874187688907008:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 74us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364960.029544:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 147 00000100:00080000:1.0:1787364960.029724:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364960.029775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364960.031944:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688906880 00000100:00100000:0.0:1787364960.031960:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688906880 00000100:00100000:0.0:1787364960.032061:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 82 00000100:00100000:0.0:1787364960.032075:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688906880:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364960.032150:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688906880:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 79us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364960.032157:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 82 00000100:00080000:1.0:1787364960.032244:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787364960.033827:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688906752 00000100:00100000:2.0:1787364960.033839:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688906752 00000100:00100000:2.0:1787364960.034297:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 294 00000100:00100000:2.0:1787364960.034323:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2365:x1874187688906752:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364960.034414:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2365:x1874187688906752:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 107us (5332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364960.034437:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 294 00000100:00100000:3.0:1787364960.132879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364960.133059:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688907264 00000100:00100000:1.0:1787364960.133069:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688907264 00000100:00100000:1.0:1787364960.133135:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 60 00000100:00100000:1.0:1787364960.133146:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+43:10428:x1874187688907264:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364960.133172:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364960.133194:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbf1 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364960.133473:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787364960.133654:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b318 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbf1 expref: 45 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.133670:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:1.0:1787364960.133672:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787364960.133676:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbf1 expref: 45 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.133713:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1e00, rc 0) 00000100:00100000:1.0:1787364960.133777:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+44:10428:x1874187688907264:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 633us (910us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787364960.133824:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 60 00000100:00100000:3.0:1787364960.156910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364960.157030:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688907392 00000100:00100000:0.0:1787364960.157042:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688907392 00000100:00100000:0.0:1787364960.157108:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00100000:0.0:1787364960.157118:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+44:10428:x1874187688907392:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:0.0:1787364960.157198:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157214:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157226:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157240:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157247:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157262:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157563:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157572:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157579:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787364960.157625:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157637:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157643:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157649:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157654:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364960.157658:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157666:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157678:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787364960.157687:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364960.157692:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157699:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b326 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157711:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157716:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157722:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157726:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364960.157729:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157734:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157741:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d3c6a8d00) 00010000:00010000:0.0:1787364960.157743:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364960.157746:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157752:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b32d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157770:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157839:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157847:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157852:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364960.157855:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157861:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157869:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364960.157871:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364960.157874:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.157880:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b334 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364960.157964:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+44:10428:x1874187688907392:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 845us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364960.157973:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00100000:3.0:1787364960.163181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364960.163266:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688907648 00000100:00100000:0.0:1787364960.163277:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688907648 00000100:00100000:0.0:1787364960.163336:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:0.0:1787364960.163346:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+44:10428:x1874187688907648:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787364960.164038:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+45:10428:x1874187688907648:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 692us (865us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787364960.164056:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:3.0:1787364960.215912:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364960.219088:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688907904 00000100:00100000:1.0:1787364960.219104:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688907904 00000100:00100000:1.0:1787364960.219239:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 62 00000100:00100000:1.0:1787364960.219251:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+45:10431:x1874187688907904:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364960.219276:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364960.219300:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b33b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbf8 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219399:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219413:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219424:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219441:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219448:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219455:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219851:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b350 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219861:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219869:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364960.219878:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787364960.219970:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219977:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219984:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.219990:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364960.219994:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220002:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220014:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364960.220017:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364960.220022:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220037:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b342 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220051:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220056:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220061:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220066:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364960.220069:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220074:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220081:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d12906a00) 00010000:00010000:1.0:1787364960.220084:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364960.220086:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220091:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220137:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b33b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbf8 expref: 48 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220151:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbf8 expref: 47 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.220165:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:1.0:1787364960.220167:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364960.220170:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0e00, rc 0) 00000100:00100000:1.0:1787364960.220242:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+47:10431:x1874187688907904:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 994us (4343us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787364960.220250:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 62 00000100:00100000:3.0:1787364960.226221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364960.226266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364960.226319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688908032 00000100:00100000:0.0:1787364960.226329:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688908032 00000100:00100000:0.0:1787364960.226410:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:0.0:1787364960.226420:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+47:2365:x1874187688908032:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364960.226434:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364960.226459:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b350 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbf8 expref: 47 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.226480:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364960.226485:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364960.226537:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+46:2365:x1874187688908032:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 118us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364960.226544:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:2.0:1787364960.232176:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688908160 00000100:00100000:2.0:1787364960.232192:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688908160 00000100:00100000:1.0:1787364960.232406:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 63 00000100:00100000:1.0:1787364960.232421:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+46:10431:x1874187688908160:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:1.0:1787364960.232501:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232520:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232531:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232558:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232565:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232572:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232579:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364960.232583:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232604:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232617:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:1.0:1787364960.232620:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787364960.232626:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.232632:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b35e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364960.232974:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+46:10431:x1874187688908160:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 555us (6705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364960.232983:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 63 00000100:00100000:0.0:1787364960.239513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364960.239640:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688908416 00000100:00100000:3.0:1787364960.239651:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688908416 00000100:00100000:3.0:1787364960.239714:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:3.0:1787364960.239725:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+46:10431:x1874187688908416:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:3.0:1787364960.239992:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+47:10431:x1874187688908416:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 268us (488us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787364960.240000:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:3.0:1787364960.519249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364960.519667:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688908672 00000100:00100000:0.0:1787364960.519678:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688908672 00000100:00100000:0.0:1787364960.519816:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00100000:0.0:1787364960.519827:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+47:10449:x1874187688908672:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:0.0:1787364960.519863:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364960.519886:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b365 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dbff expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.520137:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b36c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.520152:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.520178:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364960.520192:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787364960.520342:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b365 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbff expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.520362:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b36c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbff expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.520416:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364960.520420:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787364960.520424:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4600, rc 0) 00000100:00100000:0.0:1787364960.520492:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+49:10449:x1874187688908672:12345-192.168.204.2@tcp:101:cat.0 Request processed in 668us (1252us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787364960.520500:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 64 00000040:00080000:0.0:1787364960.524261:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787364960.582761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364960.582965:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688908800 00000100:00100000:1.0:1787364960.582976:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688908800 00000100:00100000:1.0:1787364960.583041:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 65 00000100:00100000:1.0:1787364960.583051:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+49:10450:x1874187688908800:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364960.583076:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364960.583097:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b37a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc06 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.583162:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.583175:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.583185:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364960.583408:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787364960.583412:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364960.583493:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.583523:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b37a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc06 expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.583540:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc06 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.583548:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364960.583551:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787364960.583555:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1e00, rc 0) 00000100:00100000:1.0:1787364960.583624:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+50:10450:x1874187688908800:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 574us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364960.583632:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 65 00000100:00100000:3.0:1787364960.599636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364960.601143:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688909184 00000100:00100000:1.0:1787364960.601159:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688909184 00000100:00100000:1.0:1787364960.601289:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:1.0:1787364960.601302:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+50:10450:x1874187688909184:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:1.0:1787364960.601730:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+51:10450:x1874187688909184:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 429us (2101us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787364960.601739:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:3.0:1787364960.613830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364960.613951:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688909312 00000100:00100000:0.0:1787364960.613962:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688909312 00000100:00100000:0.0:1787364960.614033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:0.0:1787364960.614044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+51:10450:x1874187688909312:12345-192.168.204.2@tcp:103:lfs.0 00010000:00010000:0.0:1787364960.614061:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787364960.614088:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbea expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.614111:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b36c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbff expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.614141:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e34e00/0xcfc9272e5fc2b21c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dbab expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364960.614152:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9100) 00010000:00010000:0.0:1787364960.614164:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364960.614226:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+48:10450:x1874187688909312:12345-192.168.204.2@tcp:103:lfs.0 Request processed in 184us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364960.614233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:3.0:1787364960.623473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364960.624617:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688909440 00000100:00100000:1.0:1787364960.624634:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688909440 00000100:00100000:1.0:1787364960.625723:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 66 00000100:00100000:1.0:1787364960.625744:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+48:10450:x1874187688909440:12345-192.168.204.2@tcp:58:lfs.0 00010000:00010000:1.0:1787364960.627060:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.627088:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.627103:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787364960.627437:0:8228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787364960.627650:0:8228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787364960.627739:0:8228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787364960.632210:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+48:10450:x1874187688909440:12345-192.168.204.2@tcp:58:lfs.0 Request processed in 6452us (8722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364960.632226:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 66 00000100:00100000:3.0:1787364960.687183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364960.687416:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688909568 00000100:00100000:1.0:1787364960.687427:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688909568 00000100:00100000:1.0:1787364960.687524:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 67 00000100:00100000:1.0:1787364960.687535:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+48:10452:x1874187688909568:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364960.687556:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364960.687578:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b38f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc0d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.687657:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.687681:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.687714:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.687729:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.687736:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.687743:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688138:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688148:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688156:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364960.688195:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787364960.688199:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364960.688217:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688228:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688236:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688252:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688258:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688264:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364960.688267:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688275:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688288:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364960.688291:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364960.688295:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688301:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688314:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688320:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688326:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688331:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364960.688340:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688346:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688355:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d12906200) 00010000:00010000:1.0:1787364960.688358:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364960.688361:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688367:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b39d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688410:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b38f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688423:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364960.688430:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906a00) 00010000:00010000:1.0:1787364960.688433:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787364960.688436:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1c00, rc 0) 00000100:00100000:1.0:1787364960.688555:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+49:10452:x1874187688909568:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1021us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364960.688562:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 67 00010000:00010000:3.0:1787364960.843414:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787364961.548887:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787364961.548896:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787364961.548939:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787364961.548946:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787364961.549109:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714104832:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787364961.549215:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d123efb40 going to sleep for 11 seconds 00000040:00080000:3.0:1787364961.550307:0:12019:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787364961.550313:0:12019:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787364961.550346:0:12019:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787364961.550370:0:12019:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787364961.558774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.560221:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688909696 00000100:00100000:1.0:1787364961.560248:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688909696 00000100:00100000:1.0:1787364961.560334:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00080000:3.0:1787364961.560427:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364961.560557:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688909696:12345-192.168.204.2@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787364961.560672:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688909696:12345-192.168.204.2@tcp:900:lhsmtool_posix.0 Request processed in 329us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.560681:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:3.0:1787364961.563535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.563841:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688909824 00000100:00100000:1.0:1787364961.563850:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688909824 00000100:00100000:1.0:1787364961.563912:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 68 00000100:00100000:1.0:1787364961.563923:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688909824:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787364961.563972:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787364961.564077:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688909824:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 156us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.564085:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 68 00000100:00100000:3.0:1787364961.567777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.567997:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688909952 00000100:00100000:1.0:1787364961.568006:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688909952 00000100:00100000:1.0:1787364961.568060:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:1.0:1787364961.568070:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688909952:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787364961.568300:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568319:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568332:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568560:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568570:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568584:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568612:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568620:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568625:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364961.568662:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787364961.568666:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364961.568682:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568693:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568699:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568705:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568710:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364961.568714:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568720:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568736:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:1.0:1787364961.568739:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364961.568744:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568750:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b3ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568761:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568766:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568771:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568775:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364961.568777:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568782:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568813:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b6d12906900) 00010000:00010000:1.0:1787364961.568816:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364961.568818:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568824:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b3b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568847:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568853:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568858:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568863:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364961.568866:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568872:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568879:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906a00) 00010000:00010000:1.0:1787364961.568881:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364961.568884:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.568890:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b3b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364961.568970:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688909952:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 Request processed in 899us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.568978:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:0.0:1787364961.569031:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714104832:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787364961.572730:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.572778:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688910208 00000100:00100000:1.0:1787364961.572812:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688910208 00000100:00100000:1.0:1787364961.572867:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 70 00000100:00100000:1.0:1787364961.572886:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+49:10463:x1874187688910208:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787364961.572908:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364961.572930:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b3c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc14 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.573781:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.573821:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.573833:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364961.573847:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787364961.573956:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.573964:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.573971:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.573977:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364961.573981:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.573989:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.574002:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906a00) 00010000:00010000:1.0:1787364961.574011:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787364961.574017:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.574024:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b3c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.574075:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b3c0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc14 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.574086:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:1.0:1787364961.574088:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787364961.574092:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b3c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc14 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.574101:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0e00, rc 0) 00000100:00100000:1.0:1787364961.574663:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688910208:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 1777us (1941us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787364961.574673:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 70 00000100:00100000:3.0:1787364961.580950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364961.582094:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688910336 00000100:00100000:2.0:1787364961.582105:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688910336 00000100:00100000:2.0:1787364961.582666:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 71 00000100:00100000:2.0:1787364961.582678:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688910336:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787364961.582712:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787364961.582841:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688910336:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 166us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364961.582849:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 71 00000100:00100000:3.0:1787364961.585294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364961.585391:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688910592 00000100:00100000:0.0:1787364961.585400:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688910592 00000100:00100000:0.0:1787364961.585461:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 72 00000100:00100000:0.0:1787364961.585470:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688910592:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364961.585489:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364961.585493:0:8228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787364961.585519:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc06 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.585539:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787364961.585544:0:8228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364961.585558:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b3d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc1b expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787364961.586190:0:8228:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787364961.586395:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b3dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.586416:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.586427:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.586487:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b3d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc1b expref: 52 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.586502:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b3dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc1b expref: 51 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.586509:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:0.0:1787364961.586511:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364961.586514:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5200, rc 0) 00000100:00100000:0.0:1787364961.586575:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+51:10463:x1874187688910592:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 1106us (1290us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787364961.586584:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 72 00000100:00100000:1.0:1787364961.600298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364961.600584:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688910848 00000100:00100000:3.0:1787364961.600595:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688910848 00000100:00100000:3.0:1787364961.600662:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 73 00000100:00100000:3.0:1787364961.600673:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+51:10463:x1874187688910848:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787364961.600735:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364961.600765:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b3dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc1b expref: 51 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.600813:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:3.0:1787364961.600823:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364961.600847:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.600861:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.600871:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.600884:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.600905:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.600912:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601191:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601200:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601207:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601213:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364961.601218:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601227:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601237:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:3.0:1787364961.601239:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364961.601243:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601249:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b3ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601258:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601270:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601276:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601282:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364961.601285:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601290:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601299:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd72f63cb (ffff9b6d10b29f00) 00010000:00010000:3.0:1787364961.601302:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364961.601305:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.601607:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b3f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd72f63cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364961.601735:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688910848:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 1063us (1445us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787364961.601742:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 73 00000100:00100000:3.0:1787364961.614934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364961.615111:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688910976 00000100:00100000:0.0:1787364961.615292:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688910976 00000100:00100000:0.0:1787364961.615523:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 74 00000100:00100000:0.0:1787364961.615535:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+50:10463:x1874187688910976:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364961.615559:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364961.615583:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b3f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc22 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.615621:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.615647:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.615660:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.615775:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b3f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.615820:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.615829:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:0.0:1787364961.615832:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787364961.615835:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4600, rc 0) 00000100:00100000:0.0:1787364961.615895:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+51:10463:x1874187688910976:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 363us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364961.615902:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 74 00000100:00100000:3.0:1787364961.623670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.624656:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688911232 00000100:00100000:1.0:1787364961.624669:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688911232 00000100:00100000:1.0:1787364961.624847:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 75 00000100:00100000:1.0:1787364961.624858:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+51:10463:x1874187688911232:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787364961.624939:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.624956:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.624994:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787364961.625580:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787364961.625593:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407854807493ns, next at 408854804504ns, rc = 0 00000004:00010000:1.0:1787364961.625697:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006769a535 reply state 00000000682d8dbf transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364961.625707:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364961.627551:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+53:10463:x1874187688911232:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 2686us (3881us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787364961.627562:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 75 00010000:00010000:1.0:1787364961.634991:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.635009:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.635017:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.635024:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364961.635030:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.635039:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.635058:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:1.0:1787364961.635061:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787364961.635074:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.635080:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b406 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364961.635914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364961.637566:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688911360 00000100:00100000:3.0:1787364961.637580:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688911360 00000100:00100000:3.0:1787364961.637716:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 76 00000100:00100000:3.0:1787364961.637728:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+52:10463:x1874187688911360:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787364961.637759:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364961.637780:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc29 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.642299:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 53 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.642317:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 53 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364961.642336:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:3.0:1787364961.642339:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787364961.642343:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031600, rc 0) 00000100:00100000:3.0:1787364961.642438:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+53:10463:x1874187688911360:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 4711us (6528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364961.642446:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 76 00000100:00100000:1.0:1787364961.652893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364961.652986:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688911488 00000100:00100000:3.0:1787364961.653000:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688911488 00000100:00100000:3.0:1787364961.653051:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:3.0:1787364961.653060:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2363:x1874187688911488:12345-192.168.204.2@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787364961.653094:0:8229:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:3.0:1787364961.653127:0:8229:0:(genops.c:1385:class_connect()) connect: client 6b97b2b3-6991-434b-88a0-aee779536483, cookie 0xcfc9272e5fc2b414 00002000:00100000:3.0:1787364961.653140:0:8229:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6b97b2b3-6991-434b-88a0-aee779536483/ffff9b6d407fa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787364961.653165:0:8229:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787364961.653438:0:8229:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787364961.653475:0:8229:0:(import.c:65:import_set_state_nolock()) ffff9b6d407fd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787364961.653560:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2363:x1874187688911488:12345-192.168.204.2@tcp:8:lhsmtool_posix.0 Request processed in 500us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364961.653569:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:0.0:1787364961.659532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.660722:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688911616 00000100:00100000:1.0:1787364961.660735:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688911616 00000100:00100000:1.0:1787364961.660890:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:1.0:1787364961.660902:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:0:x1874187688911616:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787364961.661191:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787364961.696406:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1787364961.696426:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000100:00100000:1.0:1787364961.696684:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:0:x1874187688911616:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 35778us (37155us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787364961.696696:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:0.0:1787364961.700613:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364961.700691:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688911872 00000100:00100000:3.0:1787364961.700701:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688911872 00000100:00100000:3.0:1787364961.701004:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:3.0:1787364961.701015:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+53:10463:x1874187688911872:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787364961.701256:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+54:10463:x1874187688911872:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 242us (651us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787364961.701264:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:3.0:1787364961.706770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.706881:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688912128 00000100:00100000:1.0:1787364961.706891:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688912128 00000100:00100000:1.0:1787364961.706956:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 77 00000100:00100000:1.0:1787364961.706967:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+54:10463:x1874187688912128:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787364961.707127:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+54:10463:x1874187688912128:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 161us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.707135:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 77 00000100:00100000:0.0:1787364961.710027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.710296:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688912256 00000100:00100000:1.0:1787364961.710307:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688912256 00000100:00100000:1.0:1787364961.710380:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 78 00000100:00100000:1.0:1787364961.710401:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+54:10463:x1874187688912256:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787364961.710423:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364961.710452:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b41b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc30 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.710537:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b422 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.710552:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.710563:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364961.710603:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364961.710623:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.710651:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b41b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc30 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.710667:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc30 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.710676:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:1.0:1787364961.710679:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787364961.710683:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0400, rc 0) 00000100:00100000:1.0:1787364961.710746:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+55:10463:x1874187688912256:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 356us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.710753:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 78 00000100:00100000:3.0:1787364961.715122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364961.715195:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688912384 00000100:00100000:0.0:1787364961.715205:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688912384 00000100:00100000:0.0:1787364961.715276:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 26 00000100:00100000:0.0:1787364961.715288:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2365:x1874187688912384:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364961.715306:0:8229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364961.715337:0:8229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc37 expref: -99 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787364961.715649:0:8229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a890660, blocks: 0x1 00010000:00010000:0.0:1787364961.715668:0:8229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1787364961.715673:0:8229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364961.715683:0:8229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 6 pid: 8229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.715705:0:8229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 6 pid: 8229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.715718:0:8229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5200, rc 0) 00000100:00100000:0.0:1787364961.715807:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688912384:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 521us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364961.715815:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 26 00000100:00100000:0.0:1787364961.722855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.722964:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688912640 00000100:00100000:1.0:1787364961.722974:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688912640 00000100:00100000:1.0:1787364961.723065:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 79 00000100:00100000:1.0:1787364961.723077:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+55:10463:x1874187688912640:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787364961.723209:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+55:10463:x1874187688912640:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 134us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.723227:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 79 00000100:00100000:3.0:1787364961.727690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364961.728073:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688912768 00000100:00100000:0.0:1787364961.728088:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688912768 00000100:00100000:0.0:1787364961.728296:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 27 00000100:00100000:0.0:1787364961.728318:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:10463:x1874187688912768:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364961.728338:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364961.728365:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc3e expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.728400:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 7 pid: 8229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.728434:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364961.728439:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364961.728446:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.728485:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 7 pid: 8229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.728499:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 7 pid: 8229 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364961.728513:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f9f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6709:1874187714104960:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364961.728608:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787364961.735611:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f9f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6709:1874187714104960:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364961.735663:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.735684:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5000, rc 0) 00000100:00100000:0.0:1787364961.735749:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:10463:x1874187688912768:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 7443us (8068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364961.735758:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 27 00000100:00100000:2.0:1787364961.744417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364961.744664:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688912896 00000100:00100000:0.0:1787364961.744675:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688912896 00010000:00010000:0.0:1787364961.744727:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 7 pid: 8229 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364961.745536:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:0.0:1787364961.745553:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688912896:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364961.745573:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364961.745597:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 7 pid: 8229 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.745611:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 7 pid: 8229 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.745634:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1eedd51/0xcfc9272e5fc2b429 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc37 expref: 7 pid: 8229 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.745650:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364961.745654:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364961.745662:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.745672:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.745713:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364961.745729:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f9f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874187714105088:192.168.204.2@tcp:105: 00000100:00100000:0.0:1787364961.745835:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787364961.749603:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f9f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874187714105088:192.168.204.2@tcp:105: 00010000:00010000:1.0:1787364961.749644:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364961.749705:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688912896:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 4155us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.749716:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:0.0:1787364961.753021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.753163:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688913024 00000100:00100000:1.0:1787364961.753176:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688913024 00002000:00100000:1.0:1787364961.753232:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b6d3f9f6a00 x1874187688913024/t0(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:622/0 lens 504/0 e 0 to 0 dl 1787364972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364961.753244:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d3f9f6a00 with x1874187688913024 ext(0->8) 00002000:00010000:1.0:1787364961.753250:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d3f9f6a00 00000100:00100000:1.0:1787364961.753285:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:1.0:1787364961.753296:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688913024:12345-192.168.204.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787364961.754178:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688913024:12345-192.168.204.2@tcp:4:lhsmtool_posix.0 Request processed in 879us (1160us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787364961.754190:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00002000:00100000:1.0:1787364961.754200:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b6d3f9f6a00 x1874187688913024/t4294967302(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:622/0 lens 504/448 e 0 to 0 dl 1787364972 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364961.754210:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d3f9f6a00 with x1874187688913024 ext(0->8) 00002000:00010000:1.0:1787364961.754214:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d3f9f6a00 00000100:00100000:0.0:1787364961.759724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.760280:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688913152 00000100:00100000:1.0:1787364961.760300:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688913152 00000100:00100000:1.0:1787364961.760869:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 80 00000100:00100000:1.0:1787364961.760881:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+55:10463:x1874187688913152:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787364961.844175:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+55:10463:x1874187688913152:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 Request processed in 83282us (84445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.844189:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 80 00000001:00080000:1.0:1787364961.844504:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1787364961.844542:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1787364961.844548:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:1.0:1787364961.844605:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1787364961.844614:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787364961.844646:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d02c1b300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787364961.844651:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d409baa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d02c1bc00 00000020:00080000:1.0:1787364961.844654:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d409bad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d3fe36c00 00000020:00080000:1.0:1787364961.844713:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787364961.844867:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787364961.845321:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714105216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787364961.845392:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364961.845734:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714105216 00000100:00100000:1.0:1787364961.845742:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714105216 00000100:00100000:1.0:1787364961.845841:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787364961.845851:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874187714105216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787364961.845879:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787364961.845928:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a89065c, atime: 0x6a89065c, ctime: 0x6a89065c, blocks: 0x1 00010000:00010000:1.0:1787364961.845937:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.845952:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1787364961.845977:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364961.845985:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.846002:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.846014:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.846020:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.846041:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787364961.846632:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714105216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 779us (1236us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787364961.846640:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787364961.846662:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1787364961.846668:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d40035880/2, rc 0, transno 4294967301 00010000:00010000:1.0:1787364961.846669:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364961.846674:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714105216:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787364961.846678:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787364961.846682:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.846692:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.846722:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.846730:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f91ea48/0xcfc9272e5fc2b437 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.846748:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364961.846750:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364961.846751:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787364961.848486:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787364961.849401:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787364961.849425:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714105344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787364961.849493:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364961.850009:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714105344 00000100:00100000:2.0:1787364961.850018:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714105344 00000100:00100000:2.0:1787364961.850086:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787364961.850095:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714105344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787364961.850279:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787364961.850283:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787364960 00002000:00010000:2.0:1787364961.850286:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787364961.850288:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787364960 -> 1787364960 00002000:00010000:2.0:1787364961.850290:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787364961.850340:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874187714105344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 246us (846us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787364961.850348:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787364961.850557:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787364961.850590:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d33dff100/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787364961.850597:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714105344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787364961.850756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364961.850822:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688913280 00000100:00100000:0.0:1787364961.850827:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688913280 00000100:00100000:0.0:1787364961.850856:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00100000:0.0:1787364961.850864:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688913280:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787364961.866938:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787364961.969439:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1787364961.969465:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1787364961.969566:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688913280:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 Request processed in 118695us (118805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364961.969578:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00100000:0.0:1787364961.975736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364961.975850:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688913536 00000100:00100000:1.0:1787364961.975861:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688913536 00000100:00100000:1.0:1787364961.975937:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 81 00000100:00100000:1.0:1787364961.975950:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+13:10463:x1874187688913536:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787364961.976016:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364961.976047:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b422 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc30 expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.976066:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:1.0:1787364961.976072:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364961.976103:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.976118:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364961.976145:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787364961.976436:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a86100f2 reply state 00000000e019b754 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364961.976445:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364961.976550:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:10463:x1874187688913536:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 604us (826us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787364961.976558:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 81 00010000:00010000:0.0:1787364961.980837:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.980857:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.980866:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.980872:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364961.980877:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.980884:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.980922:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:0.0:1787364961.980925:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364961.980930:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364961.980937:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b43e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364961.985920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364961.986184:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688913664 00000100:00100000:2.0:1787364961.986193:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688913664 00000100:00100000:2.0:1787364961.986260:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 31 00000100:00100000:2.0:1787364961.986270:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688913664:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787364961.986581:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787364961.986585:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787364960 -> 1787364959 00002000:00010000:2.0:1787364961.986587:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787364956 00002000:00010000:2.0:1787364961.986589:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787364960 -> 1787364959 00002000:00010000:2.0:1787364961.986592:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787364961.986856:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688913664:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 586us (947us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787364961.986865:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 31 00000100:00100000:2.0:1787364962.000118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364962.000298:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688913920 00000100:00100000:0.0:1787364962.000321:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688913920 00000100:00100000:0.0:1787364962.000412:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 82 00000100:00100000:0.0:1787364962.000591:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+13:10463:x1874187688913920:12345-192.168.204.2@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787364962.000671:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.000689:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.000699:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.000736:0:8228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.000751:0:8228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 13 pid: 5858 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364962.000767:0:8228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f9f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714105472:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364962.001246:0:8228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364962.005271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364962.005389:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688914048 00000100:00100000:3.0:1787364962.005400:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688914048 00010000:00010000:3.0:1787364962.005460:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 14 pid: 5858 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364962.005510:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:3.0:1787364962.005521:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+14:2367:x1874187688914048:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364962.005537:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364962.005544:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 14 pid: 5858 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.005557:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 14 pid: 5858 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.005582:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:3.0:1787364962.005588:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.005597:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.005605:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.005635:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364962.005691:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+14:2367:x1874187688914048:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 171us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364962.005700:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 43 00010000:00010000:2.0:1787364962.006977:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b3ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc22 expref: 13 pid: 5858 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364962.006999:0:8228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f9f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714105472:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364962.007024:0:8228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007033:0:8228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007039:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007070:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007090:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007096:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007103:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364962.007107:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007115:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007128:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:2.0:1787364962.007132:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787364962.007136:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.007142:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b445 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364962.007212:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+12:10463:x1874187688913920:12345-192.168.204.2@tcp:55:lhsmtool_posix.0 Request processed in 6791us (7105us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787364962.007222:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 82 00000100:00100000:0.0:1787364962.017246:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364962.017324:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688914176 00000100:00100000:2.0:1787364962.017343:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688914176 00000100:00100000:2.0:1787364962.017417:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00100000:2.0:1787364962.017437:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688914176:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787364962.017485:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.017520:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.017530:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787364962.017534:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787364962.017538:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.017578:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.017593:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 7 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364962.017608:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6707:1874187714105600:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364962.017699:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787364962.021254:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6707:1874187714105600:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364962.021284:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364962.023642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364962.023739:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688914304 00000100:00100000:1.0:1787364962.023749:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688914304 00010000:00010000:1.0:1787364962.023842:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 8 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364962.023884:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:1.0:1787364962.023894:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688914304:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364962.023908:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364962.023931:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 8 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.023945:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 8 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.023967:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001bd7629/0xcfc9272e5fc2b430 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc3e expref: 8 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.024005:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364962.024010:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364962.024016:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.024027:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.024290:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364962.024360:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688914304:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 456us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364962.024369:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 44 00010000:00010000:2.0:1787364962.026581:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.026601:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.026661:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.026671:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.026680:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.026688:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364962.026692:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.026701:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.026720:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364962.026728:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2b44c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364962.027705:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688914176:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 Request processed in 10261us (10459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364962.027717:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00100000:0.0:1787364962.041466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364962.041720:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688914560 00000100:00100000:1.0:1787364962.041731:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688914560 00000100:00100000:1.0:1787364962.041828:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 83 00000100:00100000:1.0:1787364962.041838:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+12:10463:x1874187688914560:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787364962.041919:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.041936:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.041948:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.042153:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.042179:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 13 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.042188:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.042222:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 13 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.042236:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 13 pid: 8228 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364962.042249:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714105728:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364962.042329:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364962.045428:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714105728:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364962.045461:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364962.062249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364962.062390:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688914688 00000100:00100000:1.0:1787364962.062400:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688914688 00010000:00010000:1.0:1787364962.062448:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 14 pid: 8228 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364962.062496:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:1.0:1787364962.062507:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:2367:x1874187688914688:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364962.062525:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364962.062545:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 14 pid: 8228 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.062559:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 14 pid: 8228 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.062583:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b40d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc29 expref: 14 pid: 8228 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.062600:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:1.0:1787364962.062606:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.062615:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.062623:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.062661:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364962.062894:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+13:2367:x1874187688914688:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 387us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364962.062902:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 45 00010000:00010000:0.0:1787364962.063010:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.063019:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787364962.063226:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787364962.063381:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787364962.063426:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787364962.063512:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874187714105856:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787364962.063567:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364962.063605:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787364962.064723:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714105856 00000100:00100000:1.0:1787364962.064734:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714105856 00000100:00100000:1.0:1787364962.064828:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787364962.064839:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874187714105856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787364962.064968:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874187714105856:12345-0@lo:1000:mdt00_001.0 Request processed in 131us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364962.064993:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787364962.065244:0:5857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787364962.065251:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d33dff100, transno 4294967303 00000100:00100000:3.0:1787364962.065276:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874187714105856:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787364962.065842:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787364962.065919:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874187714105984:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787364962.065967:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364962.065990:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40113cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364962.067245:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714105984 00000100:00100000:1.0:1787364962.067255:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714105984 00000100:00100000:1.0:1787364962.067291:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787364962.067300:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874187714105984:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787364962.067672:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1874187714105984:12345-0@lo:1000:mdt00_001.0 Request processed in 372us (1703us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787364962.067681:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787364962.068405:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874187714105984:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787364962.068448:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068460:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068467:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068473:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364962.068478:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068486:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068711:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:3.0:1787364962.068716:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787364962.068722:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068729:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b45a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068770:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068804:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068811:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068817:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364962.068820:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068827:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068836:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906a00) 00010000:00010000:3.0:1787364962.068838:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787364962.068841:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068847:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b388 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.068895:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.069006:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.069017:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.069051:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364962.069071:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 16 pid: 5857 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364962.069086:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714106112:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364962.069223:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40113300 going to sleep for 11 seconds 00000100:00100000:3.0:1787364962.074963:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714106112:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364962.074997:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364962.076242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364962.077155:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688914816 00000100:00100000:1.0:1787364962.077167:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688914816 00010000:00010000:1.0:1787364962.077213:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 17 pid: 5857 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364962.077250:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:1.0:1787364962.077259:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+17:2366:x1874187688914816:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364962.077274:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364962.077281:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 17 pid: 5857 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.077294:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 17 pid: 5857 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.077316:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b3a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc0d expref: 17 pid: 5857 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.077336:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906a00) 00010000:00010000:1.0:1787364962.077367:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.077377:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.077384:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.077418:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364962.077490:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+16:2366:x1874187688914816:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 231us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364962.077498:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 46 00010000:00010000:0.0:1787364962.077812:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077820:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077833:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077839:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077845:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077863:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364962.077868:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077875:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077885:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906a00) 00010000:00010000:0.0:1787364962.077888:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364962.077891:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077897:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b461 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077908:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077913:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077919:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077924:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364962.077927:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077933:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077952:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906a00) 00010000:00010000:0.0:1787364962.077954:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787364962.077957:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.077963:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b453 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787364962.078240:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787364962.078244:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787364962.078287:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787364962.078293:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787364962.078388:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+15:10463:x1874187688914560:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 36550us (36930us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787364962.078397:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 83 00000020:00080000:0.0:1787364962.078401:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787364962.097665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364962.097761:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688915072 00000100:00100000:1.0:1787364962.097771:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688915072 00000100:00100000:1.0:1787364962.097865:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:1.0:1787364962.097875:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+15:10463:x1874187688915072:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787364962.098633:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787364962.098745:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787364962.098823:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.098840:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.098853:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.098862:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.098881:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.098888:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364962.098911:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787364962.099009:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+17:10463:x1874187688915072:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 1133us (1351us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787364962.099018:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 20 00000020:00080000:1.0:1787364962.099023:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787364962.099328:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364962.099335:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.099342:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787364962.099346:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.099362:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.099375:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d12906200) 00010000:00010000:0.0:1787364962.099386:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787364962.099391:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.099398:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b468 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364962.099417:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364962.099419:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364962.099421:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364962.315111:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714106240:0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315209:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364962.315277:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364962.315283:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714106368:0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315313:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364962.315365:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714106624:0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315390:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364962.315406:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787364962.315411:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714106496:0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315432:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364962.315460:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714106368 00000100:00100000:1.0:1787364962.315467:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714106368 00000100:00100000:1.0:1787364962.315504:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714106624 00000100:00100000:1.0:1787364962.315507:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714106624 00000100:00100000:1.0:1787364962.315529:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714106496 00000100:00100000:1.0:1787364962.315531:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714106496 00000100:00100000:1.0:1787364962.315568:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787364962.315575:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714106368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315640:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714106368:12345-0@lo:400:kworker.0 Request processed in 65us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364962.315647:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787364962.315662:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787364962.315669:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714106624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315700:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874187714106624:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364962.315706:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787364962.315718:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787364962.315723:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714106496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315748:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714106496:12345-0@lo:400:kworker.0 Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364962.315754:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1787364962.315769:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364962.315830:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714106496:0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315841:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714106624:0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.315873:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714106368:0@lo:400:kworker.0 00000100:00100000:3.0:1787364962.316245:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714106240 00000100:00100000:3.0:1787364962.316250:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714106240 00000100:00100000:3.0:1787364962.316289:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787364962.316297:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714106240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364962.316360:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714106240:12345-0@lo:400:kworker.0 Request processed in 65us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364962.316367:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787364962.316522:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714106240:0@lo:400:kworker.0 00000100:00100000:1.0:1787364962.827035:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714106752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364962.827122:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364962.827192:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714106880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364962.827238:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714106752 00000100:00100000:1.0:1787364962.827242:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364962.827246:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714106752 00000100:00100000:3.0:1787364962.827288:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714106880 00000100:00100000:3.0:1787364962.827292:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714106880 00000100:00100000:1.0:1787364962.827295:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787364962.827305:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787364962.827305:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714106752:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364962.827310:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fa6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874187714106880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787364962.827350:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364962.827396:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714106752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364962.827403:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787364962.827449:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714106752:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364962.827526:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364962.827573:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fa6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874187714106880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364962.827589:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787364962.827744:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714106880:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787364962.891063:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787364963.465235:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1787364963.465260:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000040:00080000:1.0:1787364963.692779:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787364963.694139:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787364963.694213:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787364963.694220:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787364963.864945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364963.865024:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688915328 00000100:00100000:1.0:1787364963.865034:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688915328 00000100:00100000:1.0:1787364963.865112:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 84 00000100:00100000:1.0:1787364963.865122:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+17:10482:x1874187688915328:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364963.865148:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364963.865171:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b46f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.865473:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b476 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.865488:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.865510:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364963.865523:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787364963.865695:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b46f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc45 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.865712:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc45 expref: 19 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.865721:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364963.865724:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787364963.865728:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1800, rc 0) 00000100:00100000:1.0:1787364963.865781:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+19:10482:x1874187688915328:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 662us (846us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787364963.865815:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 84 00000100:00080000:2.0:1787364963.866105:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364963.871348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364963.871423:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688915456 00000100:00100000:3.0:1787364963.871432:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688915456 00000100:00100000:3.0:1787364963.871489:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 85 00000100:00100000:3.0:1787364963.871499:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+19:10482:x1874187688915456:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:3.0:1787364963.871572:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.871589:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.871600:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.871615:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.871622:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.871628:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.871945:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.871955:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.871962:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364963.872009:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872021:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872028:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872035:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872041:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364963.872045:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872052:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872064:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:3.0:1787364963.872066:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364963.872071:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872076:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872087:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872093:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872103:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872108:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364963.872111:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872117:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872123:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d10b29f00) 00010000:00010000:3.0:1787364963.872125:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364963.872128:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872133:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b48b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872147:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872152:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872158:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872163:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364963.872166:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872179:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872186:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d10b29500) 00010000:00010000:3.0:1787364963.872188:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364963.872190:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364963.872196:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364963.872262:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+19:10482:x1874187688915456:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 764us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364963.872269:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 85 00010000:00010000:3.0:1787364963.919810:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364963.933687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364963.934257:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688915712 00000100:00100000:1.0:1787364963.934269:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688915712 00000100:00100000:1.0:1787364963.934347:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 86 00000100:00100000:1.0:1787364963.934358:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+19:10485:x1874187688915712:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364963.934378:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364963.934410:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc4c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.934485:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.934517:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.934531:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.934549:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.934555:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.934561:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.935118:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.935127:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.935135:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364963.935144:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787364963.935881:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.935892:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.935899:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.935923:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364963.936400:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936410:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936426:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364963.936428:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364963.936433:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936439:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b4a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936452:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936457:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936462:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936468:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364963.936470:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936476:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936495:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d12906c00) 00010000:00010000:1.0:1787364963.936497:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364963.936499:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936505:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b4a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936556:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 22 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936570:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364963.936577:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:1.0:1787364963.936579:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364963.936581:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0600, rc 0) 00000100:00100000:1.0:1787364963.936653:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+21:10485:x1874187688915712:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 2295us (2975us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787364963.936662:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 86 00000100:00100000:2.0:1787364963.943478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364963.943883:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688915840 00000100:00100000:0.0:1787364963.943892:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688915840 00000100:00100000:0.0:1787364963.943955:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 87 00000100:00100000:0.0:1787364963.943965:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+21:10485:x1874187688915840:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:0.0:1787364963.944038:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944057:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944069:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944097:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944104:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944111:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944117:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364963.944132:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944140:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944153:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:0.0:1787364963.944157:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787364963.944162:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364963.944169:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364963.944249:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+21:10485:x1874187688915840:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 285us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364963.944258:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 87 00000100:00100000:2.0:1787364963.949556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364963.949846:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688916096 00000100:00100000:1.0:1787364963.949857:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688916096 00000100:00100000:1.0:1787364963.950045:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:1.0:1787364963.950058:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0631cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+21:10485:x1874187688916096:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:1.0:1787364963.950297:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0631cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+22:10485:x1874187688916096:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 242us (752us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787364963.950305:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:2.0:1787364964.055122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.055433:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688916352 00000100:00100000:3.0:1787364964.055443:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688916352 00000100:00100000:3.0:1787364964.055549:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 88 00000100:00100000:3.0:1787364964.055559:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+22:10004:x1874187688916352:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364964.055586:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364964.055609:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b4c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc53 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.055706:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.055722:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.055747:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.055814:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.055830:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 23 pid: 5858 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.055844:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714107008:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364964.055955:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26240 going to sleep for 11 seconds 00000100:00100000:3.0:1787364964.066450:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714107008:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364964.066484:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364964.070445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.072560:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688916480 00000100:00100000:1.0:1787364964.072587:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688916480 00010000:00010000:1.0:1787364964.072642:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 24 pid: 5858 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364964.072696:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00100000:1.0:1787364964.072709:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+24:2366:x1874187688916480:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364964.072726:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364964.072733:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 24 pid: 5858 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.072747:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 24 pid: 5858 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.072771:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc4c expref: 24 pid: 5858 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.072818:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:1.0:1787364964.072823:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.072833:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.072841:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.072873:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364964.073085:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+23:2366:x1874187688916480:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 376us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364964.073106:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 47 00010000:00010000:3.0:1787364964.073504:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.073513:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364964.073531:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787364964.073682:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b4c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.073702:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.073722:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:3.0:1787364964.073725:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787364964.073727:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031600, rc 0) 00000100:00100000:3.0:1787364964.073757:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+23:10004:x1874187688916352:12345-192.168.204.2@tcp:101:bash.0 Request processed in 18201us (18646us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787364964.073765:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 88 00000100:00100000:2.0:1787364964.091552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364964.091724:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688916736 00000100:00100000:0.0:1787364964.091735:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688916736 00000100:00100000:0.0:1787364964.091828:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 89 00000100:00100000:0.0:1787364964.091839:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+23:10004:x1874187688916736:12345-192.168.204.2@tcp:36:bash.0 00010000:00010000:0.0:1787364964.092434:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.092460:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.092473:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787364964.092535:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787364964.092580:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079bc5cf5 reply state 000000005323fc98 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364964.092589:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787364964.092638:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787364964.092816:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+27:10004:x1874187688916736:12345-192.168.204.2@tcp:36:bash.0 Request processed in 977us (1273us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787364964.092824:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 89 00000020:00080000:0.0:1787364964.092829:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787364964.104193:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.104211:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.104218:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.104225:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364964.104229:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.104236:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.104253:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:1.0:1787364964.104256:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364964.104261:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.104267:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b4d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364964.107541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.107890:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688916864 00000100:00100000:1.0:1787364964.107901:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688916864 00000100:00100000:1.0:1787364964.108080:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 90 00000100:00100000:1.0:1787364964.108091:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+26:10004:x1874187688916864:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:1.0:1787364964.108114:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364964.108146:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc5a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.108295:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc5a expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.108327:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc5a expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.108348:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:1.0:1787364964.108351:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787364964.108355:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0600, rc 0) 00000100:00100000:1.0:1787364964.108458:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+27:10004:x1874187688916864:12345-192.168.204.2@tcp:101:bash.0 Request processed in 369us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364964.108464:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 90 00000100:00100000:2.0:1787364964.123446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.123549:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688916992 00000100:00100000:3.0:1787364964.123560:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688916992 00000100:00100000:3.0:1787364964.123632:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:3.0:1787364964.123644:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:10004:x1874187688916992:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364964.123662:0:8229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364964.123686:0:8229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc61 expref: -99 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787364964.123715:0:8229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a89065f, atime: 0x6a89065c, ctime: 0x6a89065f, blocks: 0xb 00010000:00010000:3.0:1787364964.123735:0:8229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:3.0:1787364964.123740:0:8229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364964.123750:0:8229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 7 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.123769:0:8229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 7 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.123826:0:8229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:3.0:1787364964.123902:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:10004:x1874187688916992:12345-192.168.204.2@tcp:101:bash.0 Request processed in 260us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364964.123909:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00080000:2.0:1787364964.124029:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787364964.135125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.135234:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688917120 00000100:00100000:3.0:1787364964.135244:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688917120 00002000:00010000:3.0:1787364964.135284:0:6713:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787364964.135289:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d342ae680 with x1874187688917120 ext(0->18446744073709551615) 00002000:00010000:3.0:1787364964.135301:0:6713:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d342ae680. 00000100:00100000:3.0:1787364964.135344:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:3.0:1787364964.135353:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2367:x1874187688917120:12345-192.168.204.2@tcp:10:bash.0 00002000:00010000:3.0:1787364964.135629:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787364964.135632:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787364959 -> 1787364963 00002000:00010000:3.0:1787364964.135635:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787364956 -> 1787364956 00002000:00010000:3.0:1787364964.135637:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787364959 -> 1787364963 00002000:00010000:3.0:1787364964.135639:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787364964.135706:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688917120:12345-192.168.204.2@tcp:10:bash.0 Request processed in 354us (590us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787364964.135715:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 1 00002000:00010000:3.0:1787364964.135719:0:6713:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787364964.135722:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d342ae680 with x1874187688917120 ext(0->18446744073709551615) 00002000:00010000:3.0:1787364964.135726:0:6713:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d342ae680. 00000100:00100000:0.0:1787364964.247710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.247840:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688917248 00000100:00100000:3.0:1787364964.247850:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688917248 00000100:00100000:3.0:1787364964.247923:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 91 00000100:00100000:3.0:1787364964.247935:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+27:10499:x1874187688917248:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:3.0:1787364964.248181:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248211:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248224:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248245:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248253:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248260:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248608:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248617:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248624:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364964.248666:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248678:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248684:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248701:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248706:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.248710:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248719:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248732:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:3.0:1787364964.248736:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364964.248741:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248748:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b4ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248763:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248770:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248776:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248782:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.248850:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248869:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248878:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d10b29000) 00010000:00010000:3.0:1787364964.248881:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364964.248885:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.248891:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b4f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.249393:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.249400:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.249407:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.249412:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.249415:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.249422:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.249431:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:3.0:1787364964.249434:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364964.249437:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.249455:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b4fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.249556:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+27:10499:x1874187688917248:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 1620us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364964.249567:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 91 00000100:00100000:0.0:1787364964.304219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.304326:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688917504 00000100:00100000:3.0:1787364964.304336:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688917504 00000100:00100000:3.0:1787364964.304407:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 92 00000100:00100000:3.0:1787364964.304417:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+27:10502:x1874187688917504:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:3.0:1787364964.304439:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364964.304461:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc68 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.304539:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.304554:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.304566:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.304592:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.304600:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.304624:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305029:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305039:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305047:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364964.305056:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787364964.305156:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305163:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305169:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305174:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.305178:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305185:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305197:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:3.0:1787364964.305200:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364964.305211:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305216:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305230:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305235:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305240:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305245:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.305247:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305251:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305258:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d10b29000) 00010000:00010000:3.0:1787364964.305260:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364964.305262:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305267:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305318:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc68 expref: 30 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305346:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc68 expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.305353:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:3.0:1787364964.305357:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787364964.305359:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030600, rc 0) 00000100:00100000:3.0:1787364964.305415:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+29:10502:x1874187688917504:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 999us (1206us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787364964.305422:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 92 00000100:00100000:0.0:1787364964.318153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.318287:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688917632 00000100:00100000:3.0:1787364964.318296:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688917632 00000100:00100000:3.0:1787364964.318421:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 93 00000100:00100000:3.0:1787364964.318432:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+29:10502:x1874187688917632:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:3.0:1787364964.318500:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.318518:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.318526:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.318560:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.318574:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 29 pid: 5856 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.318602:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714107136:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364964.318711:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787364964.322636:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714107136:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364964.322681:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364964.324853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.325269:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688917888 00000100:00100000:3.0:1787364964.325279:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688917888 00000100:00100000:3.0:1787364964.325366:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:3.0:1787364964.325376:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+30:5606:x1874187688917888:12345-192.168.204.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787364964.325889:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+31:5606:x1874187688917888:12345-192.168.204.2@tcp:35:ldlm_bl.0 Request processed in 513us (1042us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787364964.325909:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:0.0:1787364964.330488:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.330767:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688918016 00000100:00100000:3.0:1787364964.330777:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688918016 00010000:00010000:2.0:1787364964.331063:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 31 pid: 5856 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364964.331157:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:2.0:1787364964.331169:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+31:2367:x1874187688918016:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364964.331185:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364964.331194:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 31 pid: 5856 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.331207:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 31 pid: 5856 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.331231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b4ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc53 expref: 31 pid: 5856 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.331269:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:2.0:1787364964.331274:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.331284:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.331313:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.331398:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364964.331454:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+30:2367:x1874187688918016:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 287us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364964.331462:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 48 00010000:00010000:3.0:1787364964.333223:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.333239:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.333275:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.333282:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.333377:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.333384:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.333450:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.333459:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.333474:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:3.0:1787364964.333477:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787364964.333481:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.333488:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.333740:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+29:10502:x1874187688917632:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 15306us (15597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364964.333751:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 93 00000100:00100000:0.0:1787364964.338138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.338231:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688918272 00000100:00100000:1.0:1787364964.338241:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688918272 00000100:00100000:1.0:1787364964.338338:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:1.0:1787364964.338351:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+29:10502:x1874187688918272:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:1.0:1787364964.338596:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+30:10502:x1874187688918272:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 247us (467us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787364964.338605:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:0.0:1787364964.438142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.438269:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688918528 00000100:00100000:1.0:1787364964.438278:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688918528 00000100:00100000:1.0:1787364964.438684:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 94 00000100:00100000:1.0:1787364964.438697:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+30:10513:x1874187688918528:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:1.0:1787364964.438723:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364964.438757:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b52c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc6f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.438866:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.438881:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.438893:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.438909:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.438916:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.438922:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.439230:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b541 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.439240:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.439247:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364964.439256:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787364964.440156:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440180:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440186:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440191:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364964.440195:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440203:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440217:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364964.440220:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364964.440225:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440232:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b533 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440247:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440253:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440258:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440263:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364964.440272:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440734:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440746:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d12906c00) 00010000:00010000:1.0:1787364964.440748:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364964.440752:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440768:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b53a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440867:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b52c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc6f expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440882:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc6f expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.440889:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:1.0:1787364964.440891:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364964.440893:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1200, rc 0) 00000100:00100000:1.0:1787364964.441084:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+32:10513:x1874187688918528:12345-192.168.204.2@tcp:101:cat.0 Request processed in 2389us (2951us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787364964.441094:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 94 00000100:00100000:0.0:1787364964.448018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.448165:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688918784 00000100:00100000:3.0:1787364964.448176:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688918784 00000100:00100000:3.0:1787364964.448235:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:3.0:1787364964.448246:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+32:10513:x1874187688918784:12345-192.168.204.2@tcp:35:cat.0 00000100:00100000:3.0:1787364964.448738:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+33:10513:x1874187688918784:12345-192.168.204.2@tcp:35:cat.0 Request processed in 492us (730us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787364964.448746:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:0.0:1787364964.476643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364964.476861:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688919040 00000100:00100000:2.0:1787364964.476872:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688919040 00000100:00100000:2.0:1787364964.476936:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 95 00000100:00100000:2.0:1787364964.476956:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+33:10514:x1874187688919040:12345-192.168.204.2@tcp:36:rm.0 00010000:00010000:2.0:1787364964.477019:0:8228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787364964.477048:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b541 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc6f expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477071:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc68 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477085:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b4df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc5a expref: 31 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477113:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d12906500) 00010000:00010000:2.0:1787364964.477123:0:8228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787364964.477143:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477157:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477167:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477180:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477187:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477194:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477498:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477506:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.477513:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787364964.478225:0:8228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787364964.478236:0:8228:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410707449657ns, next at 411707446717ns, rc = 0 00010000:00010000:2.0:1787364964.478324:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478335:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478343:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478350:0:8228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478355:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478362:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478380:0:8228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787364964.478399:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478405:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478411:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478417:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364964.478421:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478428:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478444:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364964.478447:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787364964.478451:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478458:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b55d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478473:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478479:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478485:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478490:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364964.478492:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478498:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478505:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787364964.478507:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364964.478510:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.478516:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b54f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787364964.478536:0:8228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017a74492 reply state 00000000af9457a0 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364964.478545:0:8228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787364964.478628:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+32:10514:x1874187688919040:12345-192.168.204.2@tcp:36:rm.0 Request processed in 1681us (1994us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787364964.478636:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 95 00010000:00010000:0.0:1787364964.479177:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364964.479185:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.479192:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787364964.479196:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.479203:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.479214:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787364964.479223:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787364964.479227:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.479234:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b564 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.479252:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364964.479254:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364964.479256:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364964.486278:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.486313:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.486321:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.486328:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364964.486333:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.486341:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.486359:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d104f9e00) 00010000:00010000:2.0:1787364964.486362:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364964.486366:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.486372:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b556 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364964.571940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.571997:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688919296 00000100:00100000:3.0:1787364964.572008:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688919296 00000100:00100000:0.0:1787364964.572128:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 96 00000100:00100000:0.0:1787364964.572139:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+31:10520:x1874187688919296:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:0.0:1787364964.572165:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364964.572188:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b56b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc76 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.572629:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.572645:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.572655:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.572671:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.572679:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.572701:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787364964.573233:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787364964.573401:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573412:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573421:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573454:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573462:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573469:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573475:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364964.573479:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573487:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573499:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787364964.573503:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364964.573514:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573522:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b572 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787364964.573535:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a4fd2bf reply state 0000000028145ed2 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364964.573544:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787364964.573574:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b56b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573588:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 33 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.573595:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:0.0:1787364964.573597:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364964.573600:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4600, rc 0) 00000100:00100000:0.0:1787364964.573680:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+34:10520:x1874187688919296:12345-192.168.204.2@tcp:101:bash.0 Request processed in 1543us (1749us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787364964.573690:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 96 00010000:00010000:2.0:1787364964.580889:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.580906:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.580914:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.580920:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364964.580925:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.580932:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.580949:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d3c6a8000) 00010000:00010000:2.0:1787364964.580952:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364964.580958:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.580964:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b579 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364964.584198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.584331:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688919424 00000100:00100000:1.0:1787364964.584340:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688919424 00000100:00100000:1.0:1787364964.584417:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 34 00000100:00100000:1.0:1787364964.584428:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688919424:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:1.0:1787364964.584461:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364964.584484:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc7d expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787364964.584511:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787364964.584530:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1787364964.584535:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364964.584544:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.584564:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787364964.584944:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787364964.585048:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0c00, rc 0) 00000100:00100000:1.0:1787364964.585871:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688919424:12345-192.168.204.2@tcp:101:bash.0 Request processed in 1439us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364964.585880:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 34 00000100:00100000:0.0:1787364964.595140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.595528:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688919552 00000100:00100000:3.0:1787364964.595539:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688919552 00000100:00100000:3.0:1787364964.595597:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:3.0:1787364964.595606:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:10520:x1874187688919552:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364964.595631:0:8229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364964.595649:0:8229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc84 expref: -99 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.595680:0:8229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.595689:0:8229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364964.595693:0:8229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364964.595698:0:8229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 7 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.595732:0:8229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.595745:0:8229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 7 pid: 6709 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.595759:0:8229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8229:1874187714107264:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364964.595886:0:8229:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787364964.603482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.603695:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688919680 00000100:00100000:1.0:1787364964.603704:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688919680 00010000:00010000:1.0:1787364964.603744:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 8 pid: 6709 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364964.603813:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:1.0:1787364964.603824:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688919680:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364964.603841:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364964.603863:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 8 pid: 6709 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.603899:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 8 pid: 6709 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.603925:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364964.603929:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364964.603937:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 8 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.603948:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 8 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.603988:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 8 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364964.604003:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874187714107392:192.168.204.2@tcp:105: 00000100:00100000:1.0:1787364964.604076:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40113f00 going to sleep for 11 seconds 00010000:00010000:3.0:1787364964.607747:0:8229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b0c9fd/0xcfc9272e5fc2b58e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc7d expref: 8 pid: 6709 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.607821:0:8229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8229:1874187714107264:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364964.607857:0:8229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 7 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.607872:0:8229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030200, rc 0) 00000100:00100000:3.0:1787364964.611445:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:10520:x1874187688919552:12345-192.168.204.2@tcp:101:bash.0 Request processed in 15826us (16301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364964.611459:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:1.0:1787364964.615715:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874187714107392:192.168.204.2@tcp:105: 00010000:00010000:1.0:1787364964.615744:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364964.615837:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688919680:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 12014us (12363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364964.615849:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:2.0:1787364964.623205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.626639:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688919936 00000100:00100000:3.0:1787364964.626656:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688919936 00000100:00100000:3.0:1787364964.626737:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:3.0:1787364964.626749:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+33:10520:x1874187688919936:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:3.0:1787364964.627154:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+34:10520:x1874187688919936:12345-192.168.204.2@tcp:35:bash.0 Request processed in 406us (3958us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787364964.627162:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:0.0:1787364964.811405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364964.811499:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688920064 00000100:00100000:2.0:1787364964.811509:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688920064 00000100:00100000:2.0:1787364964.811575:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 97 00000100:00100000:2.0:1787364964.811585:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+34:10536:x1874187688920064:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364964.811622:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364964.811645:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b59c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc8b expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.811709:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b5a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.811722:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.811735:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364964.811820:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787364964.811825:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364964.811852:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.811878:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b59c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc8b expref: 36 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.811895:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc8b expref: 35 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.811904:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787364964.811907:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787364964.811910:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449000, rc 0) 00000100:00100000:2.0:1787364964.811984:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+35:10536:x1874187688920064:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 400us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364964.811991:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 97 00000100:00100000:0.0:1787364964.819906:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.820438:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688920320 00000100:00100000:1.0:1787364964.820447:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688920320 00000100:00100000:1.0:1787364964.820507:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 98 00000100:00100000:1.0:1787364964.820518:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+35:10536:x1874187688920320:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364964.820552:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364964.820572:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b5aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc92 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.820674:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b5b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.820689:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.820700:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364964.820710:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787364964.820878:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b5aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc92 expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.820896:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc92 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.820904:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:1.0:1787364964.820908:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364964.820911:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1e00, rc 0) 00000100:00100000:1.0:1787364964.820977:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+37:10536:x1874187688920320:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 461us (1081us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787364964.820984:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 98 00000100:00100000:0.0:1787364964.825068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364964.825159:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688920576 00000100:00100000:2.0:1787364964.825169:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688920576 00000100:00100000:2.0:1787364964.825229:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 99 00000100:00100000:2.0:1787364964.825239:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+37:10536:x1874187688920576:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364964.825265:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364964.825305:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b5bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dc99 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.825414:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b5c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.825427:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b5c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.825438:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b5c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364964.825449:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787364964.825582:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b5bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc99 expref: 40 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.825598:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b5c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc99 expref: 39 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364964.825607:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:2.0:1787364964.825609:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787364964.825613:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449c00, rc 0) 00000100:00100000:2.0:1787364964.825675:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+39:10536:x1874187688920576:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 437us (616us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787364964.825698:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 99 00000100:00100000:2.0:1787364964.833385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364964.833446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364964.833627:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688920704 00000100:00100000:0.0:1787364964.833637:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688920704 00000100:00100000:0.0:1787364964.833723:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:0.0:1787364964.833734:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+39:2365:x1874187688920704:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364964.833751:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364964.833779:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b5b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc92 expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364964.833837:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:0.0:1787364964.833843:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364964.833900:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+38:2365:x1874187688920704:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 168us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364964.833907:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:3.0:1787364964.834424:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688920832 00000100:00100000:3.0:1787364964.834430:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688920832 00000100:00100000:3.0:1787364964.834476:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 36 00000100:00100000:3.0:1787364964.834485:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688920832:12345-192.168.204.2@tcp:1:lfs.0 00010000:00010000:3.0:1787364964.834521:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.834539:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 6 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.834560:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787364964.834576:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787364964.834581:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.834616:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 6 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.834631:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 6 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.834645:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6707:1874187714107520:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364964.834723:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787364964.837163:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6707:1874187714107520:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364964.837197:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364964.838823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.838898:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688920960 00000100:00100000:1.0:1787364964.838906:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688920960 00002000:00100000:1.0:1787364964.838958:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b6d3fc31f80 x1874187688920960/t0(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:625/0 lens 504/0 e 0 to 0 dl 1787364975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364964.838983:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d3fc31f80 with x1874187688920960 ext(0->8) 00010000:00010000:1.0:1787364964.838993:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 7 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.839008:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 7 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787364964.839015:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d3fc31f80 00000100:00100000:1.0:1787364964.839050:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:1.0:1787364964.839060:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2367:x1874187688920960:12345-192.168.204.2@tcp:4:lfs.0 00000100:00100000:1.0:1787364964.839574:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6b97b2b3-6991-434b-88a0-aee779536483+9:2367:x1874187688920960:12345-192.168.204.2@tcp:4:lfs.0 Request processed in 514us (795us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787364964.839583:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 1 00002000:00100000:1.0:1787364964.839591:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b6d3fc31f80 x1874187688920960/t4294967302(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:625/0 lens 504/448 e 0 to 0 dl 1787364975 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364964.839598:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d3fc31f80 with x1874187688920960 ext(0->8) 00010000:00010000:1.0:1787364964.839604:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 9 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.839616:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 9 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787364964.839623:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d3fc31f80 00000100:00100000:2.0:1787364964.843902:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.844075:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688921088 00000100:00100000:1.0:1787364964.844099:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688921088 00010000:00010000:1.0:1787364964.844139:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 9 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364964.844179:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 50 00000100:00100000:1.0:1787364964.844188:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+9:2367:x1874187688921088:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364964.844203:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787364964.844220:0:5841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787364964.844223:0:5841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787364963 00002000:00010000:1.0:1787364964.844225:0:5841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787364963 00002000:00010000:1.0:1787364964.844227:0:5841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787364963 00010000:00010000:1.0:1787364964.844234:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 9 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.844247:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 9 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.844274:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2b595 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc84 expref: 9 pid: 8229 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.844309:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364964.844314:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364964.844321:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.844331:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.844375:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364964.844429:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688921088:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 242us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364964.844437:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 50 00010000:00010000:3.0:1787364964.844932:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.844945:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.844970:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.844987:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.844994:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.845001:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364964.845006:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.845015:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.845028:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.845036:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b5d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.845100:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688920832:12345-192.168.204.2@tcp:1:lfs.0 Request processed in 10615us (11652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364964.845108:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 36 00000100:00100000:2.0:1787364964.850130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.850207:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688921344 00000100:00100000:3.0:1787364964.850218:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688921344 00000100:00100000:3.0:1787364964.850381:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 26 00000100:00100000:3.0:1787364964.850421:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0631d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+38:10536:x1874187688921344:12345-192.168.204.2@tcp:35:lfs.0 00000004:00010000:3.0:1787364964.850490:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b5c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc99 expref: 38 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787364964.850739:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787364964.850775:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787364964.851082:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787364964.851137:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.851152:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.851162:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.851197:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.851210:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 42 pid: 5856 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.851223:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874187714107648:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364964.851385:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787364964.854901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.855003:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874187714107648:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364964.855033:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364964.855380:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688921472 00000100:00100000:1.0:1787364964.855387:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688921472 00010000:00010000:1.0:1787364964.855424:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 43 pid: 5856 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364964.855464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:1.0:1787364964.855473:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+43:2367:x1874187688921472:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364964.855490:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364964.855496:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 43 pid: 5856 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.855506:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 43 pid: 5856 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.855527:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b580 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc76 expref: 43 pid: 5856 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.855542:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:1.0:1787364964.855547:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.855556:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.855588:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.855613:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364964.855664:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+42:2367:x1874187688921472:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 192us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364964.855672:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 51 00010000:00010000:3.0:1787364964.855729:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.855742:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787364964.855895:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787364964.856087:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787364964.856189:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714107776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787364964.856241:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364964.856266:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33de0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787364964.856421:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714107776 00000100:00100000:1.0:1787364964.856427:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714107776 00000100:00100000:1.0:1787364964.856468:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787364964.856475:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714107776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787364964.856544:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714107776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364964.856551:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787364964.856723:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787364964.857208:0:5859:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787364964.857214:0:5859:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787364964.857230:0:5859:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d40035880, transno 4294967301 00000100:00100000:3.0:1787364964.857251:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714107776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787364964.857979:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787364964.858045:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714107904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787364964.858095:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364964.858122:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787364964.858236:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714107904 00000100:00100000:1.0:1787364964.858244:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714107904 00000100:00100000:1.0:1787364964.858307:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787364964.858317:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714107904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787364964.858468:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5859:x1874187714107904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (372us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787364964.858477:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787364964.859228:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714107904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787364964.859426:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787364964.859474:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.859485:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.859493:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.859499:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.859515:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.859523:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.859538:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:3.0:1787364964.859541:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787364964.859546:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.859552:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787364964.859911:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787364964.860001:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787364964.860013:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411089226942ns, next at 412089224777ns, rc = 0 00000001:00080000:3.0:1787364964.860019:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787364964.860056:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d3c6a8d00) 00010000:00010000:3.0:1787364964.860059:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787364964.860066:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b5c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc99 expref: 46 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.860185:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0631d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+45:10536:x1874187688921344:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 9767us (10065us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787364964.860194:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 26 00000020:00080000:3.0:1787364964.860199:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787364964.864033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.864120:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688921600 00000100:00100000:1.0:1787364964.864130:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688921600 00000100:00100000:1.0:1787364964.864197:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 100 00000100:00100000:1.0:1787364964.864208:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+45:10536:x1874187688921600:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364964.864232:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364964.864268:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b5e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dca0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.864353:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dca0 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.864367:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dca0 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364964.864385:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364964.864388:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787364964.864392:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0e00, rc 0) 00000100:00100000:1.0:1787364964.864454:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+46:10536:x1874187688921600:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 248us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364964.864461:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 100 00000100:00100000:2.0:1787364964.868408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364964.868740:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688921856 00000100:00100000:1.0:1787364964.868748:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688921856 00000100:00100000:1.0:1787364964.868835:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 27 00000100:00100000:1.0:1787364964.868845:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+46:10536:x1874187688921856:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:1.0:1787364964.869072:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+47:10536:x1874187688921856:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 229us (684us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787364964.869079:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 27 00010000:00010000:3.0:1787364964.939301:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364964.991467:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364964.991551:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688921984 00000100:00100000:3.0:1787364964.991570:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688921984 00000100:00100000:3.0:1787364964.991642:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 101 00000100:00100000:3.0:1787364964.991667:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+47:10546:x1874187688921984:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:3.0:1787364964.991749:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.991767:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.991779:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.991822:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.991829:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.991837:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.991935:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.991943:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.991949:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364964.991991:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992003:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992014:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992022:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992028:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.992032:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992040:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992052:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:3.0:1787364964.992055:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364964.992059:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992065:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b5e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992080:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992087:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992093:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992098:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.992108:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992115:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992123:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d10b29000) 00010000:00010000:3.0:1787364964.992126:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364964.992129:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992135:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b5f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992150:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992155:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992161:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992165:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364964.992168:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992651:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992662:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:3.0:1787364964.992665:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364964.992675:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364964.992681:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b5f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364964.992826:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+47:10546:x1874187688921984:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 1159us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364964.992834:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 101 00000100:00100000:0.0:1787364965.051155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364965.051256:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688922240 00000100:00100000:1.0:1787364965.051267:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688922240 00000100:00100000:1.0:1787364965.051364:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 102 00000100:00100000:1.0:1787364965.051374:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+47:10549:x1874187688922240:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364965.051407:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364965.051443:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b5fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dca7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051524:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051537:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051550:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051576:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051583:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051590:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051720:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051729:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051736:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364965.051746:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787364965.051872:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051889:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051896:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051902:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364965.051906:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051914:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.051926:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:1.0:1787364965.051930:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364965.052143:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052151:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b605 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052167:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052173:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052180:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052185:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364965.052194:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052201:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052209:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d12906400) 00010000:00010000:1.0:1787364965.052211:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364965.052215:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052221:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b60c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052263:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b5fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dca7 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052277:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dca7 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.052284:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364965.052286:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364965.052288:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0c00, rc 0) 00000100:00100000:1.0:1787364965.052549:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+49:10549:x1874187688922240:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1176us (1403us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787364965.052566:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 102 00000100:00080000:2.0:1787364965.052736:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364965.058721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.058891:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688922368 00000100:00100000:0.0:1787364965.058901:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688922368 00000100:00100000:0.0:1787364965.059058:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 103 00000100:00100000:0.0:1787364965.059070:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+49:10549:x1874187688922368:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:0.0:1787364965.059144:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059162:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059173:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059198:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059219:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059227:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059233:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364965.059237:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059245:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059256:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787364965.059259:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787364965.059264:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.059270:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364965.059444:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+49:10549:x1874187688922368:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 377us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.059452:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 103 00000100:00100000:2.0:1787364965.062008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364965.062129:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688922624 00000100:00100000:3.0:1787364965.062139:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688922624 00000100:00100000:3.0:1787364965.062196:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 28 00000100:00100000:3.0:1787364965.062206:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+49:10549:x1874187688922624:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:3.0:1787364965.062451:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+50:10549:x1874187688922624:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 245us (450us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787364965.062459:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 28 00000100:00100000:2.0:1787364965.148736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364965.148823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364965.148847:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364965.148880:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364965.149061:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688923008 00000100:00100000:3.0:1787364965.149071:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688923008 00000100:00100000:3.0:1787364965.149130:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688922880 00000100:00100000:3.0:1787364965.149132:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688922880 00000100:00100000:3.0:1787364965.149158:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 83 00000100:00100000:3.0:1787364965.149168:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+8:2364:x1874187688923008:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364965.149242:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+8:2364:x1874187688923008:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 76us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364965.149250:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 83 00000100:00100000:3.0:1787364965.149266:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 84 00000100:00100000:3.0:1787364965.149283:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688922880:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364965.149335:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688922880:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 63us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364965.149341:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 84 00000100:00100000:0.0:1787364965.150281:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688922752 00000100:00100000:0.0:1787364965.150296:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688922752 00000100:00100000:0.0:1787364965.150339:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 296 00000100:00100000:0.0:1787364965.150347:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688922752:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364965.150406:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688922752:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 59us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.150424:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 296 00000100:00100000:0.0:1787364965.150459:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688923136 00000100:00100000:0.0:1787364965.150463:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688923136 00000100:00100000:0.0:1787364965.150501:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 151 00000100:00100000:0.0:1787364965.150508:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688923136:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364965.150539:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688923136:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 32us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.150545:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 151 00000100:00080000:2.0:1787364965.151525:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364965.163603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364965.163827:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688923392 00000100:00100000:3.0:1787364965.163837:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688923392 00000100:00100000:3.0:1787364965.163905:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 104 00000100:00100000:3.0:1787364965.163916:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+50:10559:x1874187688923392:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364965.163946:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364965.163950:0:8228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787364965.163978:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b5a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc8b expref: 50 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.163997:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:3.0:1787364965.164002:0:8228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364965.164016:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b628 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcae expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.164120:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b62f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.164135:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.164146:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364965.164157:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787364965.164358:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b628 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcae expref: 52 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.164452:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcae expref: 51 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.164460:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:3.0:1787364965.164463:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787364965.164465:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030e00, rc 0) 00000100:00100000:3.0:1787364965.164527:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+51:10559:x1874187688923392:12345-192.168.204.2@tcp:101:bash.0 Request processed in 613us (936us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787364965.164534:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 104 00000100:00100000:2.0:1787364965.168359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.168467:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688923648 00000100:00100000:0.0:1787364965.168476:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688923648 00000100:00100000:0.0:1787364965.168536:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 105 00000100:00100000:0.0:1787364965.168546:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+51:10559:x1874187688923648:12345-192.168.204.2@tcp:36:bash.0 00010000:00010000:0.0:1787364965.168613:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787364965.168640:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b62f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcae expref: 51 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.168662:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dca7 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.168671:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787364965.168676:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364965.168934:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.168949:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.168973:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787364965.169025:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787364965.169054:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5105acb reply state 0000000082e0a7e0 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364965.169065:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787364965.169159:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+52:10559:x1874187688923648:12345-192.168.204.2@tcp:36:bash.0 Request processed in 613us (809us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787364965.169166:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 105 00000020:00080000:0.0:1787364965.169172:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787364965.177085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.177168:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688923776 00000100:00100000:0.0:1787364965.177178:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688923776 00000100:00100000:0.0:1787364965.177241:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 106 00000100:00100000:0.0:1787364965.177253:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+52:10559:x1874187688923776:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:0.0:1787364965.177278:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364965.177311:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b644 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcb5 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.177403:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.177417:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.177426:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.177462:0:8228:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.177472:0:8228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177666:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177674:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177679:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177685:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364965.177687:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177694:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177707:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:3.0:1787364965.177710:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364965.177712:0:3299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177727:0:3299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177733:0:3299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177763:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364965.177770:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b63d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.178312:0:8228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.178321:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364965.178355:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787364965.178359:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787364965.178377:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.178406:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b644 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 53 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.178419:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 52 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.178426:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787364965.178428:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364965.178431:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5000, rc 0) 00000100:00100000:0.0:1787364965.178513:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+52:10559:x1874187688923776:12345-192.168.204.2@tcp:101:bash.0 Request processed in 1262us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.178522:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 106 00000100:00100000:2.0:1787364965.184003:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364965.184246:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688924032 00000100:00100000:3.0:1787364965.184256:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688924032 00000100:00100000:3.0:1787364965.184334:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:3.0:1787364965.184344:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+52:10559:x1874187688924032:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:3.0:1787364965.184610:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+53:10559:x1874187688924032:12345-192.168.204.2@tcp:35:bash.0 Request processed in 267us (617us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787364965.184617:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:3.0:1787364965.274488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.275188:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688924160 00000100:00100000:0.0:1787364965.275199:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688924160 00000100:00100000:0.0:1787364965.275385:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 107 00000100:00100000:0.0:1787364965.275407:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+53:10565:x1874187688924160:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787364965.275432:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364965.275454:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcbc expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.275533:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.275548:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.275780:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364965.275863:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787364965.275868:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787364965.275893:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.275923:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2b652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcbc expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.275941:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcbc expref: 54 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.275950:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787364965.275953:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787364965.275971:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4000, rc 0) 00000100:00100000:0.0:1787364965.276044:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+54:10565:x1874187688924160:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 641us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.276051:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 107 00000100:00100000:2.0:1787364965.281301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.281378:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688924288 00000100:00100000:0.0:1787364965.281389:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688924288 00000100:00100000:0.0:1787364965.281449:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 108 00000100:00100000:0.0:1787364965.281458:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+54:10565:x1874187688924288:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787364965.281478:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364965.281501:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b660 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcc3 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281647:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281663:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281674:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281689:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281697:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281703:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281849:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281863:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281871:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364965.281906:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787364965.281911:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787364965.281929:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281941:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281949:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281955:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281962:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281969:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364965.281973:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281980:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.281992:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787364965.281995:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364965.282006:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282013:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2b667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282025:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282031:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282036:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282040:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364965.282043:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282047:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282054:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d3c6a8b00) 00010000:00010000:0.0:1787364965.282056:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364965.282059:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282063:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2b66e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282093:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2b660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcc3 expref: 56 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282118:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcc3 expref: 55 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.282125:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787364965.282127:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364965.282130:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40878000, rc 0) 00000100:00100000:0.0:1787364965.282194:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+55:10565:x1874187688924288:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 737us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.282201:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 108 00000100:00100000:2.0:1787364965.289574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364965.289622:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.289701:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688924672 00000100:00100000:0.0:1787364965.289711:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688924672 00000100:00100000:0.0:1787364965.289781:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:0.0:1787364965.289821:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+55:2364:x1874187688924672:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364965.289837:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364965.289862:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcc3 expref: 55 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.289880:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787364965.289885:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364965.289936:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+54:2364:x1874187688924672:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 119us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.289944:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787364965.290014:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688924544 00000100:00100000:1.0:1787364965.290019:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688924544 00000100:00100000:1.0:1787364965.290053:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 109 00000100:00100000:1.0:1787364965.290061:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+54:10565:x1874187688924544:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364965.290091:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364965.290106:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b67c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcca expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.290202:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.290216:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 55 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.290225:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.290256:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 55 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.290269:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 55 pid: 8228 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364965.290283:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714108032:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364965.290356:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063f9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787364965.298526:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714108032:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364965.298566:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364965.300265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.300375:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688924800 00000100:00100000:0.0:1787364965.300384:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688924800 00010000:00010000:0.0:1787364965.300435:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 56 pid: 8228 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364965.300494:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 52 00000100:00100000:0.0:1787364965.300503:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+56:2367:x1874187688924800:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364965.300519:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364965.300525:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 56 pid: 8228 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.300537:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 56 pid: 8228 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.300570:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2b64b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcb5 expref: 56 pid: 8228 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.300587:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787364965.300592:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.300600:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.300608:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.300642:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364965.300698:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+55:2367:x1874187688924800:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 196us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.300706:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 52 00010000:00010000:1.0:1787364965.301052:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.301061:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364965.301092:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787364965.301246:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b67c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.301262:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.301269:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364965.301272:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787364965.301274:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1e00, rc 0) 00000100:00100000:1.0:1787364965.301325:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+55:10565:x1874187688924544:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 11265us (11761us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787364965.301333:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 109 00000100:00100000:2.0:1787364965.307053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364965.307132:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688925056 00000100:00100000:1.0:1787364965.307142:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688925056 00000100:00100000:1.0:1787364965.307212:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:1.0:1787364965.307221:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+55:10565:x1874187688925056:12345-192.168.204.2@tcp:103:lfs.0 00010000:00010000:1.0:1787364965.307238:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364965.307263:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b5e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dca0 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364965.307302:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364965.307307:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364965.307365:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+54:10565:x1874187688925056:12345-192.168.204.2@tcp:103:lfs.0 Request processed in 145us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364965.307373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:3.0:1787364965.310595:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.310691:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688925184 00000100:00100000:0.0:1787364965.310714:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688925184 00000100:00100000:0.0:1787364965.310777:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 110 00000100:00100000:0.0:1787364965.310822:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+54:10565:x1874187688925184:12345-192.168.204.2@tcp:58:lfs.0 00010000:00010000:0.0:1787364965.310935:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.310953:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.310964:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787364965.311145:0:8228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787364965.311235:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+54:10565:x1874187688925184:12345-192.168.204.2@tcp:58:lfs.0 Request processed in 449us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.311243:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 110 00000100:00100000:2.0:1787364965.314595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364965.314682:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688925312 00000100:00100000:0.0:1787364965.314693:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688925312 00000100:00100000:0.0:1787364965.314781:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 111 00000100:00100000:0.0:1787364965.314822:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+54:10565:x1874187688925312:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787364965.314844:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364965.314867:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcd1 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.314925:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.314937:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd1 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.314979:0:5856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.314994:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd1 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.315008:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787364965.315011:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787364965.315015:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd1 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364965.315023:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879c00, rc 0) 00000100:00100000:0.0:1787364965.315084:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+55:10565:x1874187688925312:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 265us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364965.315091:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 111 00010000:00010000:2.0:1787364965.963396:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787364966.155038:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787364966.155047:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787364966.155121:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787364966.155130:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787364966.155277:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714108160:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787364966.155444:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063f9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787364966.169439:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714108160:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787364966.173055:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.173164:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688925440 00000100:00100000:0.0:1787364966.173173:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688925440 00000100:00100000:0.0:1787364966.173235:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 112 00000100:00100000:0.0:1787364966.173246:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+55:10566:x1874187688925440:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787364966.173297:0:8228:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787364966.173402:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+55:10566:x1874187688925440:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 158us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.173411:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 112 00000100:00100000:2.0:1787364966.189704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364966.189833:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688925568 00000100:00100000:1.0:1787364966.189844:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688925568 00000100:00100000:1.0:1787364966.189898:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 113 00000100:00100000:1.0:1787364966.189908:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+55:10566:x1874187688925568:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787364966.189982:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.189999:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190011:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190064:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190072:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190080:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190102:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190125:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190133:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364966.190174:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787364966.190178:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364966.190191:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190202:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190208:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190214:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190219:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364966.190224:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190230:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190241:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:1.0:1787364966.190244:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364966.190248:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190285:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b69f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190301:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190307:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190313:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190317:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364966.190320:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190326:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190334:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b6d12906400) 00010000:00010000:1.0:1787364966.190336:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364966.190339:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190344:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b6a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190358:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190363:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190374:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190379:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364966.190382:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190387:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190395:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364966.190397:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364966.190399:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.190404:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b6ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364966.190478:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+55:10566:x1874187688925568:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 Request processed in 571us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364966.190486:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 113 00000100:00100000:3.0:1787364966.197621:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.201442:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688925824 00000100:00100000:0.0:1787364966.201458:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688925824 00000100:00100000:0.0:1787364966.201598:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 114 00000100:00100000:0.0:1787364966.201624:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+55:10566:x1874187688925824:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364966.201664:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364966.201687:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcd8 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.201812:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.201828:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.201839:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364966.201851:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787364966.201963:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.201970:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.201976:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.201983:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364966.201987:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.201995:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.202007:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787364966.202017:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787364966.202022:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.202028:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.202073:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6b4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd8 expref: 57 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.202084:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:0.0:1787364966.202086:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787364966.202090:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd8 expref: 57 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.202100:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879200, rc 0) 00000100:00100000:0.0:1787364966.202176:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+56:10566:x1874187688925824:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 555us (4565us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787364966.202184:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 114 00000100:00100000:3.0:1787364966.210167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.210277:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688925952 00000100:00100000:0.0:1787364966.210286:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688925952 00000100:00100000:0.0:1787364966.210347:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 115 00000100:00100000:0.0:1787364966.210356:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+56:10566:x1874187688925952:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787364966.210392:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787364966.210498:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+56:10566:x1874187688925952:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 143us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.210506:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 115 00000100:00100000:3.0:1787364966.216146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364966.216245:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688926208 00000100:00100000:2.0:1787364966.216266:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688926208 00000100:00100000:2.0:1787364966.216367:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 116 00000100:00100000:2.0:1787364966.216378:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+56:10566:x1874187688926208:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364966.216401:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364966.216404:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787364966.216431:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4000/0xcfc9272e5fc2b659 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcbc expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.216451:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787364966.216456:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787364966.216469:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b6c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcdf expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787364966.216946:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787364966.217170:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b6d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.217184:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.217194:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.217247:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b6c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcdf expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.217263:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcdf expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.217288:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:2.0:1787364966.217291:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364966.217294:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448800, rc 0) 00000100:00100000:2.0:1787364966.217363:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+57:10566:x1874187688926208:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 987us (1226us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787364966.217370:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 116 00000100:00100000:3.0:1787364966.224644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.224755:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688926464 00000100:00100000:0.0:1787364966.224779:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688926464 00000100:00100000:0.0:1787364966.224884:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 117 00000100:00100000:0.0:1787364966.224896:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+57:10566:x1874187688926464:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787364966.224960:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364966.224992:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b6d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcdf expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225013:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:0.0:1787364966.225026:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364966.225048:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225064:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225075:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225134:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225142:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225148:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225229:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225237:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225265:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225280:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364966.225284:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225292:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225301:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787364966.225304:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364966.225308:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225314:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b6de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225325:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225332:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225338:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225343:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364966.225346:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225362:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225370:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2f4c68a5 (ffff9b6d3c6a8b00) 00010000:00010000:0.0:1787364966.225373:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364966.225375:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.225381:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b6e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2f4c68a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.225467:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+56:10566:x1874187688926464:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 572us (831us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787364966.225476:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 117 00000100:00100000:3.0:1787364966.229982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.233387:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688926592 00000100:00100000:0.0:1787364966.233402:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688926592 00000100:00100000:0.0:1787364966.233523:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 118 00000100:00100000:0.0:1787364966.233535:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+56:10566:x1874187688926592:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364966.233557:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364966.233581:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b6ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dce6 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.233618:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.233632:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.233643:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.233765:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b6ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 58 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.233810:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 57 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.233819:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:0.0:1787364966.233822:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787364966.233826:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879e00, rc 0) 00000100:00100000:0.0:1787364966.233895:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+57:10566:x1874187688926592:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 362us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.233903:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 118 00000100:00100000:3.0:1787364966.239394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.239502:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688926848 00000100:00100000:0.0:1787364966.239513:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688926848 00000100:00100000:0.0:1787364966.239580:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 119 00000100:00100000:0.0:1787364966.239593:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+57:10566:x1874187688926848:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787364966.239687:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.239705:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.239717:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787364966.240009:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1787364966.240018:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412469231941ns, next at 413469229937ns, rc = 0 00000004:00010000:0.0:1787364966.240125:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003af13124 reply state 000000002a71f65e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.240135:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787364966.240223:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+59:10566:x1874187688926848:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 631us (840us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787364966.240231:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 119 00010000:00010000:2.0:1787364966.249470:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.249490:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.249497:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.249504:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364966.249509:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.249516:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.249532:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:2.0:1787364966.249536:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787364966.249541:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.249548:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b6fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.250098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364966.250465:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688926976 00000100:00100000:2.0:1787364966.250475:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688926976 00000100:00100000:2.0:1787364966.250526:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 120 00000100:00100000:2.0:1787364966.250645:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+58:10566:x1874187688926976:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364966.250672:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364966.250694:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dced expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.250755:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.250770:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.254501:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:3.0:1787364966.254513:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787364966.254518:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448000, rc 0) 00000100:00100000:3.0:1787364966.254717:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+59:10566:x1874187688926976:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 4176us (4619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364966.254727:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 120 00000100:00100000:3.0:1787364966.264946:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.265050:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688927104 00000100:00100000:0.0:1787364966.265060:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688927104 00000100:00100000:0.0:1787364966.265136:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:0.0:1787364966.265146:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+8:2365:x1874187688927104:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787364966.265388:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787364966.265713:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+9:2365:x1874187688927104:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 567us (775us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787364966.265721:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:3.0:1787364966.272769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364966.275478:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688927360 00000100:00100000:1.0:1787364966.275493:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688927360 00000100:00100000:1.0:1787364966.276504:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00100000:1.0:1787364966.276521:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+59:10566:x1874187688927360:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787364966.276811:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+60:10566:x1874187688927360:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 296us (4051us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787364966.276820:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00100000:3.0:1787364966.282623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364966.282718:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688927616 00000100:00100000:2.0:1787364966.282728:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688927616 00000100:00100000:2.0:1787364966.282820:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 121 00000100:00100000:2.0:1787364966.282830:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+60:10566:x1874187688927616:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787364966.282938:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+60:10566:x1874187688927616:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 110us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364966.282945:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 121 00000100:00100000:3.0:1787364966.287158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.287282:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688927744 00000100:00100000:0.0:1787364966.287292:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688927744 00000100:00100000:0.0:1787364966.287350:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 122 00000100:00100000:0.0:1787364966.287362:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+60:10566:x1874187688927744:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364966.287383:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364966.287406:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b708 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcf4 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.287504:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b70f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.287518:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b70f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.287540:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b70f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364966.287579:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787364966.287598:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b70f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.287625:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b708 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcf4 expref: 62 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.287642:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b70f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcf4 expref: 61 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.287651:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:0.0:1787364966.287654:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787364966.287658:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879600, rc 0) 00000100:00100000:0.0:1787364966.287731:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+61:10566:x1874187688927744:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 371us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.287737:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 122 00000100:00100000:2.0:1787364966.295149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364966.295243:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688927872 00000100:00100000:1.0:1787364966.295264:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688927872 00000100:00100000:1.0:1787364966.295331:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 38 00000100:00100000:1.0:1787364966.295341:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:2367:x1874187688927872:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787364966.295360:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364966.295382:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dcfb expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787364966.295411:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a890665, blocks: 0x1 00010000:00010000:1.0:1787364966.295435:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787364966.295440:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364966.295449:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 10 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.295468:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 10 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.295482:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1c00, rc 0) 00000100:00100000:1.0:1787364966.295545:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+10:2367:x1874187688927872:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 205us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364966.295553:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 38 00000100:00100000:2.0:1787364966.300885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.300984:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688928128 00000100:00100000:0.0:1787364966.300994:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688928128 00000100:00100000:0.0:1787364966.301053:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 123 00000100:00100000:0.0:1787364966.301063:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+61:10566:x1874187688928128:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787364966.301174:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+61:10566:x1874187688928128:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.301183:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 123 00000100:00100000:3.0:1787364966.306213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.306334:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688928256 00000100:00100000:0.0:1787364966.306359:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688928256 00000100:00100000:0.0:1787364966.306418:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:0.0:1787364966.306429:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+10:10566:x1874187688928256:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364966.306448:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364966.306466:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd02 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.306496:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 11 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.306504:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364966.306507:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364966.306512:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.306560:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 11 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.306575:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 11 pid: 6709 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.306590:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a98a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6707:1874187714108288:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364966.306694:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18830240 going to sleep for 11 seconds 00000100:00100000:0.0:1787364966.309882:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a98a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6707:1874187714108288:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364966.309924:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.309971:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879800, rc 0) 00000100:00100000:2.0:1787364966.310637:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+11:10566:x1874187688928256:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 4207us (4430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364966.310658:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:2.0:1787364966.313741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.313895:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688928384 00000100:00100000:0.0:1787364966.313905:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688928384 00010000:00010000:0.0:1787364966.313950:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 11 pid: 6709 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.313995:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:0.0:1787364966.314006:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+11:2367:x1874187688928384:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364966.314022:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364966.314044:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 11 pid: 6709 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.314057:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 11 pid: 6709 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.314080:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6f19ac0/0xcfc9272e5fc2b716 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcfb expref: 11 pid: 6709 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.314098:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364966.314103:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364966.314112:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.314123:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.314183:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.314198:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874187714108416:192.168.204.2@tcp:105: 00000100:00100000:0.0:1787364966.315145:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d18830240 going to sleep for 11 seconds 00000100:00100000:0.0:1787364966.323549:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874187714108416:192.168.204.2@tcp:105: 00010000:00010000:0.0:1787364966.323578:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364966.323636:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+10:2367:x1874187688928384:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 9631us (9903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.323646:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:2.0:1787364966.330638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364966.330737:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688928512 00000100:00100000:1.0:1787364966.330747:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688928512 00002000:00100000:1.0:1787364966.330829:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b6d401b9880 x1874187688928512/t0(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:627/0 lens 504/0 e 0 to 0 dl 1787364977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364966.330841:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d401b9880 with x1874187688928512 ext(0->12) 00002000:00010000:1.0:1787364966.330861:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d401b9880 00000100:00100000:1.0:1787364966.330883:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:1.0:1787364966.330893:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6b97b2b3-6991-434b-88a0-aee779536483+10:2367:x1874187688928512:12345-192.168.204.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787364966.331514:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6b97b2b3-6991-434b-88a0-aee779536483+12:2367:x1874187688928512:12345-192.168.204.2@tcp:4:lhsmtool_posix.0 Request processed in 620us (883us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787364966.331523:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 2 00002000:00100000:1.0:1787364966.331531:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b6d401b9880 x1874187688928512/t4294967308(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:627/0 lens 504/448 e 0 to 0 dl 1787364977 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364966.331540:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d401b9880 with x1874187688928512 ext(0->12) 00002000:00010000:1.0:1787364966.331544:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d401b9880 00000100:00100000:2.0:1787364966.337612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.337708:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688928640 00000100:00100000:0.0:1787364966.337718:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688928640 00000100:00100000:0.0:1787364966.337777:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 124 00000100:00100000:0.0:1787364966.337824:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+61:10566:x1874187688928640:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787364966.401262:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+61:10566:x1874187688928640:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 Request processed in 63455us (63641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364966.401303:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 124 00000001:00080000:2.0:1787364966.404137:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1787364966.404149:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:2.0:1787364966.404190:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1787364966.404222:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1787364966.404238:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1787364966.404271:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787364966.404285:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d33de0300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787364966.404290:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d200eb600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d33de0e40 00000020:00080000:2.0:1787364966.404293:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d200ebd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d05789000 00000020:00080000:2.0:1787364966.404322:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d40113180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787364966.404325:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d40f4ee00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d40113840 00000020:00080000:2.0:1787364966.404328:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d40f4e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d02c7a800 00000020:00080000:1.0:1787364966.404507:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787364966.404749:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787364966.404888:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787364966.404908:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714108544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787364966.405083:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364966.405147:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714108544 00000100:00100000:1.0:1787364966.405153:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714108544 00000100:00100000:1.0:1787364966.405200:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787364966.405210:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874187714108544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787364966.405240:0:6709:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787364966.405393:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a890663, atime: 0x6a890663, ctime: 0x6a890663, blocks: 0x1 00010000:00010000:1.0:1787364966.405401:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.405418:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787364966.405434:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364966.405441:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.405458:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.405468:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.405476:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.405495:0:6709:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787364966.405697:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714108672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787364966.405734:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364966.405755:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787364966.405760:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714108800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787364966.405780:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364966.405825:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714108672 00000100:00100000:3.0:1787364966.405829:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714108672 00000100:00100000:3.0:1787364966.405851:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714108800 00000100:00100000:3.0:1787364966.405854:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714108800 00000100:00100000:3.0:1787364966.405865:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787364966.405872:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714108672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787364966.405885:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1787364966.405909:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.405925:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 11 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.405933:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787364966.405936:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787364966.405940:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.405968:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 11 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.405995:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 11 pid: 8229 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.406008:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6707:1874187714108928:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364966.406066:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787364966.406162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364966.406184:0:8229:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787364966.406191:0:8229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787364966.406355:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688928768 00000100:00100000:3.0:1787364966.406358:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688928768 00000100:00100000:3.0:1787364966.406426:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787364966.406434:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714108800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787364966.406593:0:12088:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787364966.406602:0:12088:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787364965 00002000:00010000:3.0:1787364966.406605:0:12088:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787364966.406607:0:12088:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787364965 -> 1787364965 00002000:00010000:3.0:1787364966.406610:0:12088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787364966.406651:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3315:x1874187714108800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (869us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787364966.406658:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1787364966.406696:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d34242300/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787364966.406702:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714108800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787364966.406719:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:3.0:1787364966.406727:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+12:2365:x1874187688928768:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787364966.408664:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714108544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3449us (3684us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787364966.408675:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787364966.408747:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787364966.408756:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.408767:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787364966.408771:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.408814:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.408847:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.408856:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b724 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.408875:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364966.408876:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364966.408878:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787364966.408886:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787364966.408891:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787364966.409478:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d409d5c00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787364966.409486:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714108544:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787364966.414442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364966.416457:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6707:1874187714108928:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364966.416489:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.416907:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688928896 00000100:00100000:0.0:1787364966.416915:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688928896 00010000:00010000:0.0:1787364966.416952:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 13 pid: 8229 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.416998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 54 00000100:00100000:0.0:1787364966.417007:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+13:2366:x1874187688928896:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364966.417022:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364966.417027:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 13 pid: 8229 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.417050:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 13 pid: 8229 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.417076:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a03052a/0xcfc9272e5fc2b4e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc61 expref: 13 pid: 8229 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.417093:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787364966.417097:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787364966.417103:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.417113:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.417136:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364966.417193:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+12:2366:x1874187688928896:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 187us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.417201:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 54 00010000:00010000:3.0:1787364966.417851:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.417863:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.417873:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.417881:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.417904:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787364966.418572:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1874187714108672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12697us (12833us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787364966.418583:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1787364966.418642:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d34241880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787364966.418649:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714108672:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787364966.418796:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364966.418805:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.418815:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787364966.418819:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.418843:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.418861:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.418869:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2b72b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.418890:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364966.418892:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364966.418894:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787364966.470599:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1787364966.470617:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787364966.470625:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1787364966.470634:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1787364966.470905:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688928768:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 Request processed in 64172us (64735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364966.470917:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:2.0:1787364966.476954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.477612:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688929152 00000100:00100000:0.0:1787364966.477621:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688929152 00000100:00100000:0.0:1787364966.477722:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 125 00000100:00100000:0.0:1787364966.477732:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+15:10566:x1874187688929152:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787364966.477782:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364966.477843:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b70f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcf4 expref: 15 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.477863:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:0.0:1787364966.477867:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364966.477893:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.477908:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.477931:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787364966.478649:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083de615d reply state 00000000890872d9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.478661:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787364966.478763:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+16:10566:x1874187688929152:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 1031us (1817us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787364966.478771:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 125 00010000:00010000:1.0:1787364966.482168:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.482187:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.482195:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.482202:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364966.482207:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.482216:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.482260:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:1.0:1787364966.482272:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364966.482278:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.482285:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b732 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364966.489941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364966.490302:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688929280 00000100:00100000:3.0:1787364966.490312:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688929280 00000100:00100000:3.0:1787364966.490367:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:3.0:1787364966.490379:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688929280:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787364966.490623:0:8229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787364966.490628:0:8229:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787364965 -> 1787364964 00002000:00010000:3.0:1787364966.490630:0:8229:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787364963 00002000:00010000:3.0:1787364966.490633:0:8229:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787364965 -> 1787364964 00002000:00010000:3.0:1787364966.490635:0:8229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787364966.490706:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688929280:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 329us (774us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787364966.490714:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:3.0:1787364966.499620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.499824:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688929536 00000100:00100000:0.0:1787364966.499835:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688929536 00000100:00100000:0.0:1787364966.499898:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 126 00000100:00100000:0.0:1787364966.499908:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+15:10566:x1874187688929536:12345-192.168.204.2@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787364966.499994:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.500012:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 15 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.500023:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.500064:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 15 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.500079:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 15 pid: 8228 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.500116:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a98000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714109056:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364966.500212:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d07138480 going to sleep for 11 seconds 00000100:00100000:0.0:1787364966.504572:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a98000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714109056:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364966.504606:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.506079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.506505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688929664 00000100:00100000:0.0:1787364966.506514:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688929664 00010000:00010000:0.0:1787364966.506568:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 16 pid: 8228 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.506616:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 55 00000100:00100000:0.0:1787364966.506626:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+16:2366:x1874187688929664:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364966.506645:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364966.506651:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 16 pid: 8228 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.506664:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 16 pid: 8228 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.506688:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b6f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dce6 expref: 16 pid: 8228 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.506704:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:0.0:1787364966.506709:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.506733:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.506741:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.506768:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364966.506874:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+15:2366:x1874187688929664:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 249us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.506882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 55 00010000:00010000:3.0:1787364966.507841:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.507852:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.507901:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.507908:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.507915:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.507921:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364966.507926:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.507934:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.507946:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:3.0:1787364966.507949:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787364966.507953:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.507959:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b739 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.508048:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:10566:x1874187688929536:12345-192.168.204.2@tcp:55:lhsmtool_posix.0 Request processed in 8139us (8435us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787364966.508057:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 126 00000100:00100000:3.0:1787364966.517745:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364966.519098:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688929792 00000100:00100000:1.0:1787364966.519110:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688929792 00000100:00100000:1.0:1787364966.519176:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:1.0:1787364966.519186:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688929792:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787364966.519231:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.519267:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.519278:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364966.519282:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364966.519288:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.519323:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.519339:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 7 pid: 6707 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364966.519373:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6710:1874187714109184:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364966.519512:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063f9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787364966.529847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364966.529966:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6710:1874187714109184:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364966.530056:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.530127:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688929920 00000100:00100000:3.0:1787364966.530134:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688929920 00010000:00010000:3.0:1787364966.530182:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 8 pid: 6707 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.530275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 56 00000100:00100000:3.0:1787364966.530284:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688929920:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364966.530301:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364966.530324:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 8 pid: 6707 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.530337:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 8 pid: 6707 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.530363:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bf72b99/0xcfc9272e5fc2b71d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd02 expref: 8 pid: 6707 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.530379:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787364966.530383:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787364966.530402:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.530413:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.530443:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364966.530504:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688929920:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 220us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364966.530513:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 56 00010000:00010000:1.0:1787364966.530739:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.530749:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.530775:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.530804:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.530813:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.530821:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787364966.530826:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.530847:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.530859:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.530868:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021f40a9f/0xcfc9272e5fc2b740 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364966.530913:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688929792:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 Request processed in 11728us (13181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364966.530921:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:1.0:1787364966.539724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364966.539821:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688930176 00000100:00100000:3.0:1787364966.539831:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688930176 00000100:00100000:3.0:1787364966.539892:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 127 00000100:00100000:3.0:1787364966.539903:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+14:10566:x1874187688930176:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787364966.540151:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.540168:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.540180:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.540631:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.540646:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.540655:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.540693:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.540708:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 15 pid: 5857 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.540721:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714109312:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364966.540938:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364966.548304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.548398:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688930304 00000100:00100000:0.0:1787364966.548407:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688930304 00010000:00010000:0.0:1787364966.548447:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 16 pid: 5857 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364966.548488:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00100000:0.0:1787364966.548497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+16:2366:x1874187688930304:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364966.548514:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364966.548521:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 16 pid: 5857 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.548546:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 16 pid: 5857 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.548575:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:0.0:1787364966.548581:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.548613:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.548622:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364966.548645:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364966.548715:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+16:2366:x1874187688930304:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 218us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364966.548724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 57 00010000:00010000:3.0:1787364966.550867:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b701 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dced expref: 15 pid: 5857 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.550891:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714109312:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364966.550917:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.551071:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.551080:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787364966.551515:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787364966.551723:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787364966.551768:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787364966.552077:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874187714109440:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787364966.552139:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364966.552209:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364966.552408:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714109440 00000100:00100000:1.0:1787364966.552416:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714109440 00000100:00100000:1.0:1787364966.552516:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787364966.552535:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1874187714109440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787364966.552619:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1874187714109440:12345-0@lo:1000:mdt00_002.0 Request processed in 95us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364966.552627:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787364966.552679:0:5858:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1787364966.552684:0:5858:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1787364966.552701:0:5858:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d34242300, transno 4294967309 00000100:00100000:2.0:1787364966.552718:0:5858:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b6d34241880 x1874187714108672/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787364982 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364966.552730:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874187714109440:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787364966.553174:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787364966.553237:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874187714109568:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787364966.553295:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364966.554129:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364966.554160:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714109568 00000100:00100000:0.0:1787364966.554167:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714109568 00000100:00100000:0.0:1787364966.554204:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787364966.554213:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1874187714109568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787364966.554675:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5858:x1874187714109568:12345-0@lo:1000:mdt00_002.0 Request processed in 461us (1377us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787364966.554683:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787364966.554897:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874187714109568:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787364966.554937:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.554947:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.554964:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555039:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364966.555043:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555052:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555068:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d3c6a8f00) 00010000:00010000:2.0:1787364966.555072:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364966.555076:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555082:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b74e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555112:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555118:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555123:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555127:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364966.555129:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555145:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555153:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:2.0:1787364966.555155:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364966.555161:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd1 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555171:0:5858:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd1 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555181:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd1 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.555211:0:5858:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd1 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364966.555224:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714109696:192.168.204.2@tcp:105: 00000100:00100000:2.0:1787364966.555648:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d123ef240 going to sleep for 11 seconds 00000100:00100000:0.0:1787364966.564148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364966.564927:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688930432 00000100:00100000:3.0:1787364966.564938:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688930432 00000100:00100000:3.0:1787364966.565015:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 31 00000100:00100000:3.0:1787364966.565026:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+19:10565:x1874187688930432:12345-192.168.204.2@tcp:49:lfs.0 00000100:00100000:3.0:1787364966.565158:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+19:10565:x1874187688930432:12345-192.168.204.2@tcp:49:lfs.0 Request processed in 133us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364966.565165:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 31 00000100:00100000:1.0:1787364966.566906:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714109696:192.168.204.2@tcp:105: 00010000:00010000:1.0:1787364966.566938:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.566949:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2b691 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567002:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567016:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567027:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567039:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567046:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567052:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567057:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364966.567061:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567068:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567080:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364966.567083:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364966.567086:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567091:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b755 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567109:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567114:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567120:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567124:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364966.567127:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567132:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567139:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364966.567141:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787364966.567143:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.567148:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b747 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364966.567733:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+18:10566:x1874187688930176:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 27830us (28026us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787364966.567744:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 127 00000020:00080000:1.0:1787364966.567750:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787364966.572550:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787364966.572559:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787364966.573135:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787364966.573143:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787364966.578975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.579087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364966.579217:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688930944 00000100:00100000:1.0:1787364966.579228:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688930944 00000100:00100000:1.0:1787364966.579332:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 128 00000100:00100000:1.0:1787364966.579342:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+18:10565:x1874187688930944:12345-192.168.204.2@tcp:58:lfs.0 00000040:00080000:1.0:1787364966.579736:0:8228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787364966.580665:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688930688 00000100:00100000:3.0:1787364966.580673:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688930688 00000100:00100000:3.0:1787364966.580765:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00100000:3.0:1787364966.580775:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d05538050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+19:10566:x1874187688930688:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787364966.581715:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787364966.581834:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787364966.581881:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.581898:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.581909:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.581927:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.581934:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.581940:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.581960:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787364966.582291:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+21:10565:x1874187688930944:12345-192.168.204.2@tcp:58:lfs.0 Request processed in 2945us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364966.582302:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 128 00000100:00100000:3.0:1787364966.582628:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d05538050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+20:10566:x1874187688930688:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 1852us (3664us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787364966.582636:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 32 00000020:00080000:3.0:1787364966.582641:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787364966.582739:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787364966.582747:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.582756:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787364966.582760:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.582768:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.582782:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d10b29400) 00010000:00010000:1.0:1787364966.582797:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787364966.582802:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.582808:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b75c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364966.582825:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364966.582827:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364966.582829:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364966.633746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364966.633937:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688931072 00000100:00100000:2.0:1787364966.633947:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688931072 00000100:00100000:2.0:1787364966.634011:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 129 00000100:00100000:2.0:1787364966.634022:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+20:10568:x1874187688931072:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364966.634069:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364966.634095:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b763 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd09 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.634171:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.635405:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.635427:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.635452:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.635460:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.635468:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.635764:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.635779:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.637939:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.638008:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.638046:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 21 pid: 5858 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364966.638063:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714109824:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364966.638147:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d123ef900 going to sleep for 11 seconds 00000100:00100000:2.0:1787364966.643311:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714109824:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364966.643356:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364966.643823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364966.644380:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688931328 00000100:00100000:0.0:1787364966.644388:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688931328 00000100:00100000:0.0:1787364966.644494:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:0.0:1787364966.644505:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+22:5606:x1874187688931328:12345-192.168.204.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787364966.644781:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+23:5606:x1874187688931328:12345-192.168.204.2@tcp:35:ldlm_bl.0 Request processed in 277us (995us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787364966.644822:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:0.0:1787364966.654513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364966.655028:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688931456 00000100:00100000:3.0:1787364966.655038:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688931456 00010000:00010000:3.0:1787364966.655083:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 23 pid: 5858 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364966.655124:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 58 00000100:00100000:3.0:1787364966.655133:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+23:2366:x1874187688931456:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364966.655148:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364966.655155:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 23 pid: 5858 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.655168:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 23 pid: 5858 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.655209:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2b683 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcca expref: 23 pid: 5858 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.655226:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:3.0:1787364966.655231:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.655254:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.655272:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364966.655303:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364966.655365:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+22:2366:x1874187688931456:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 232us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364966.655373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 58 00010000:00010000:2.0:1787364966.655596:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655604:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364966.655648:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787364966.655653:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364966.655672:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655684:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655692:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655699:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655717:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655723:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364966.655728:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655736:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655746:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787364966.655749:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364966.655753:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655759:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b76a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655770:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655776:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655781:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655846:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364966.655849:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655865:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655874:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d104f9800) 00010000:00010000:2.0:1787364966.655877:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364966.655880:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655886:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b771 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655925:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b763 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd09 expref: 22 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655937:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd09 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364966.655943:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:2.0:1787364966.655945:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364966.655948:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449000, rc 0) 00000100:00100000:2.0:1787364966.655990:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+21:10568:x1874187688931072:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 21970us (22255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364966.655997:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 129 00010000:00010000:0.0:1787364966.989626:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364967.435623:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714110080:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.435705:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364967.435759:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714110592:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.435813:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364967.435844:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787364967.435850:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714109952:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.435877:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364967.435916:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714110464:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.435937:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364967.435962:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714110208:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.435986:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364967.436003:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787364967.436008:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714110336:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436027:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364967.436063:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714110080 00000100:00100000:1.0:1787364967.436071:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714110080 00000100:00100000:1.0:1787364967.436113:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714110464 00000100:00100000:1.0:1787364967.436116:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714110464 00000100:00100000:1.0:1787364967.436135:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714110208 00000100:00100000:1.0:1787364967.436137:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714110208 00000100:00100000:1.0:1787364967.436153:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787364967.436160:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714110080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436209:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714110080:12345-0@lo:400:kworker.0 Request processed in 49us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364967.436216:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787364967.436233:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787364967.436239:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714110464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436278:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714110464:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364967.436284:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787364967.436301:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787364967.436308:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714110208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436338:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714110208:12345-0@lo:400:kworker.0 Request processed in 31us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364967.436344:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787364967.436362:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714110592 00000100:00100000:1.0:1787364967.436365:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714110592 00000100:00100000:1.0:1787364967.436388:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714110336 00000100:00100000:1.0:1787364967.436391:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714110336 00000100:00100000:1.0:1787364967.436408:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787364967.436414:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714110592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436444:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714110592:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364967.436449:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787364967.436460:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787364967.436466:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714110336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436489:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714110336:12345-0@lo:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364967.436495:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787364967.436511:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714109952 00000100:00100000:1.0:1787364967.436514:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714109952 00000100:00100000:1.0:1787364967.436537:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787364967.436543:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714109952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436570:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714109952:12345-0@lo:400:kworker.0 Request processed in 27us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364967.436575:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1787364967.436610:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364967.436655:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714110336:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436666:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714110208:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436694:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714109952:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436703:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714110464:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436710:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714110080:0@lo:400:kworker.0 00000100:00100000:1.0:1787364967.436719:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714110592:0@lo:400:kworker.0 00000040:00080000:0.0:1787364967.628917:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787364967.628927:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787364967.628988:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787364967.628995:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787364967.629127:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a99f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714110720:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787364967.629303:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d062dc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787364967.634202:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a99f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714110720:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787364967.639764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364967.640815:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688931584 00000100:00100000:3.0:1787364967.640828:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688931584 00000100:00100000:3.0:1787364967.640913:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 130 00000100:00100000:3.0:1787364967.640924:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+21:10579:x1874187688931584:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787364967.640960:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787364967.641061:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+21:10579:x1874187688931584:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 138us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364967.641069:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 130 00000100:00080000:3.0:1787364967.641095:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364967.647089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364967.648247:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688931840 00000100:00100000:3.0:1787364967.648276:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688931840 00000100:00100000:3.0:1787364967.648345:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 131 00000100:00100000:3.0:1787364967.648356:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+21:10579:x1874187688931840:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787364967.648378:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364967.648400:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b77f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364967.648516:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364967.648531:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364967.648543:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364967.648553:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787364967.648681:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b77f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd10 expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364967.648701:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd10 expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364967.648709:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:3.0:1787364967.648712:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787364967.648716:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:3.0:1787364967.648810:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+23:10579:x1874187688931840:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 456us (1731us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787364967.648819:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 131 00000100:00100000:3.0:1787364967.657382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364967.657425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364967.657544:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688932224 00000100:00100000:2.0:1787364967.657555:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688932224 00000100:00100000:2.0:1787364967.657635:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:2.0:1787364967.657645:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+23:2366:x1874187688932224:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364967.657662:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364967.657686:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b786 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd10 expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364967.657706:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:2.0:1787364967.657710:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364967.657772:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+22:2366:x1874187688932224:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 128us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364967.657779:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:1.0:1787364967.658126:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688932096 00000100:00100000:1.0:1787364967.658131:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688932096 00000100:00100000:1.0:1787364967.658172:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 132 00000100:00100000:1.0:1787364967.658180:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+22:10579:x1874187688932096:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787364967.658266:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658282:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658293:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658488:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658497:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658504:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658523:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364967.658527:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658535:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658544:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364967.658547:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787364967.658551:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364967.658558:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b794 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364967.658680:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+23:10579:x1874187688932096:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 500us (1307us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787364967.658688:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 132 00000040:00080000:2.0:1787364967.659726:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787364967.659733:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787364967.660752:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787364967.660768:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787364967.666588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364967.666672:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688932480 00000100:00100000:1.0:1787364967.666683:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688932480 00000100:00100000:1.0:1787364967.666745:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 34 00000100:00100000:1.0:1787364967.666756:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+23:10579:x1874187688932480:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787364967.667037:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+24:10579:x1874187688932480:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 283us (458us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787364967.667045:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 34 00000040:00080000:1.0:1787364967.751658:0:12126:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787364967.751670:0:12126:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787364967.751725:0:12126:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787364967.751732:0:12126:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787364967.951878:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714110848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364967.951956:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364967.952042:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714110848 00000100:00100000:2.0:1787364967.952049:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714110848 00000100:00100000:2.0:1787364967.952100:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787364967.952110:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714110848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364967.952150:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364967.952195:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714110848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364967.952203:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787364967.952280:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714110848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364967.958987:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714110976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364967.959065:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364967.959297:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714110976 00000100:00100000:3.0:1787364967.959304:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714110976 00000100:00100000:3.0:1787364967.959358:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787364967.959368:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874187714110976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364967.959417:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364967.959466:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874187714110976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364967.959473:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787364967.959777:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714110976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787364968.013491:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364968.090508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364968.090662:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688932736 00000100:00100000:3.0:1787364968.090671:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688932736 00000100:00100000:3.0:1787364968.090741:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 133 00000100:00100000:3.0:1787364968.090750:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+24:10592:x1874187688932736:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:3.0:1787364968.090774:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364968.090815:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b79b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364968.090914:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b7a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364968.090929:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b7a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364968.090940:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b7a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364968.090950:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787364968.091092:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b79b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd17 expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364968.091112:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b7a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd17 expref: 26 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364968.091120:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:3.0:1787364968.091123:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787364968.091127:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030a00, rc 0) 00000100:00100000:3.0:1787364968.091207:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+26:10592:x1874187688932736:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 458us (708us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787364968.091214:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 133 00000100:00100000:3.0:1787364968.095432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364968.097912:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688932864 00000100:00100000:1.0:1787364968.097928:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688932864 00000100:00100000:1.0:1787364968.098059:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 134 00000100:00100000:1.0:1787364968.098071:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+26:10592:x1874187688932864:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:1.0:1787364968.098150:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098167:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098179:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098204:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098212:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098219:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098226:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364968.098240:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098249:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098281:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:1.0:1787364968.098284:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787364968.098289:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.098297:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0e00/0xcfc9272e5fc2b7b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364968.098385:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+26:10592:x1874187688932864:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 317us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364968.098394:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 134 00000100:00100000:2.0:1787364968.231701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364968.232325:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688932992 00000100:00100000:1.0:1787364968.232336:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688932992 00000100:00100000:1.0:1787364968.232481:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:1.0:1787364968.232565:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688932992:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:1.0:1787364968.232586:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364968.232608:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b7b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd1e expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787364968.232633:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a890664, atime: 0x6a890663, ctime: 0x6a890664, blocks: 0xb 00010000:00010000:1.0:1787364968.232653:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1787364968.232658:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364968.232667:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b7b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd1e expref: 7 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.232685:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b7b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd1e expref: 7 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364968.232718:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0e00, rc 0) 00000100:00100000:1.0:1787364968.232774:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688932992:12345-192.168.204.2@tcp:101:cat.0 Request processed in 283us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364968.232781:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00080000:3.0:1787364968.233164:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787364968.236912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364968.237178:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688933120 00000100:00100000:0.0:1787364968.237188:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688933120 00002000:00100000:0.0:1787364968.237258:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b6d40d7fb80 x1874187688933120/t0(0) o3->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:629/0 lens 488/0 e 0 to 0 dl 1787364979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787364968.237270:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d40d7fb80 with x1874187688933120 ext(0->4095) 00002000:00010000:0.0:1787364968.237276:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d40d7fb80 00000100:00100000:0.0:1787364968.237311:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:0.0:1787364968.237323:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688933120:12345-192.168.204.2@tcp:3:cat.0 00000100:00100000:0.0:1787364968.237592:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688933120:12345-192.168.204.2@tcp:3:cat.0 Request processed in 270us (689us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787364968.237617:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 3 00002000:00100000:0.0:1787364968.237626:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b6d40d7fb80 x1874187688933120/t0(0) o3->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:629/0 lens 488/4536 e 0 to 0 dl 1787364979 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787364968.237633:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d40d7fb80 with x1874187688933120 ext(0->4095) 00002000:00010000:0.0:1787364968.237636:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d40d7fb80 00000001:00080000:2.0:1787364968.547813:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787364968.547834:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:0.0:1787364969.040163:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364970.062029:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364970.274072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364970.274121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364970.274163:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688933248 00000100:00100000:3.0:1787364970.274179:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688933248 00000100:00100000:1.0:1787364970.274222:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688933376 00000100:00100000:1.0:1787364970.274226:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688933376 00000100:00100000:3.0:1787364970.274250:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 298 00000100:00100000:3.0:1787364970.274260:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688933248:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364970.274275:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 155 00000100:00100000:1.0:1787364970.274281:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+26:2364:x1874187688933376:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364970.274563:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+26:2364:x1874187688933376:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 281us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364970.274573:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 155 00000100:00080000:2.0:1787364970.275039:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364970.275854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364970.275920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364970.275960:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688933632 00000100:00100000:1.0:1787364970.275968:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688933632 00000100:00100000:3.0:1787364970.276582:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688933504 00000100:00100000:3.0:1787364970.276587:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688933504 00000100:00100000:0.0:1787364970.276875:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688933248:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 2612us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364970.276887:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 298 00000100:00100000:1.0:1787364970.277269:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 87 00000100:00100000:1.0:1787364970.277281:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688933632:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364970.277345:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688933632:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 68us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364970.277353:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 87 00000100:00100000:0.0:1787364970.283047:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 88 00000100:00100000:0.0:1787364970.283067:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:2365:x1874187688933504:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364970.283151:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:2365:x1874187688933504:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 91us (7230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364970.283159:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 88 00000100:00100000:1.0:1787364970.290234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364970.290363:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688933760 00000100:00100000:3.0:1787364970.290374:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688933760 00000100:00100000:3.0:1787364970.290444:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 156 00000100:00100000:3.0:1787364970.290455:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2365:x1874187688933760:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364970.290552:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2365:x1874187688933760:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 99us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364970.290561:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 156 00000100:00080000:2.0:1787364970.291495:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787364970.291505:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364970.291508:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1787364970.763742:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787364970.763751:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787364970.763799:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787364970.763810:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787364971.083098:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787364971.643649:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:2.0:1787364971.643683:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1787364971.643704:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787364971.643735:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d187d2600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787364971.643741:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d061a2200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d187d2cc0 00000020:00080000:2.0:1787364971.643744:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d061a2600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d407ca400 00000001:00080000:2.0:1787364971.643759:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787364971.646462:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787364971.646693:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1787364971.662029:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787364971.662055:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1787364972.109488:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364972.555937:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714111488:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556005:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364972.556065:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787364972.556072:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714111360:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556101:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364972.556246:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714111360 00000100:00100000:0.0:1787364972.556253:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714111360 00000100:00100000:0.0:1787364972.556305:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787364972.556328:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714111360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556382:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714111360:12345-0@lo:400:kworker.0 Request processed in 56us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364972.556389:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787364972.556574:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714111360:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556629:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714111232:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556656:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364972.556674:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714111744:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556697:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364972.556716:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787364972.556721:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714111104:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556748:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364972.556769:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714111616:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556816:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364972.556844:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714111488 00000100:00100000:0.0:1787364972.556848:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714111488 00000100:00100000:0.0:1787364972.556875:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714111744 00000100:00100000:0.0:1787364972.556878:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714111744 00000100:00100000:0.0:1787364972.556896:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787364972.556902:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714111488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.556939:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714111488:12345-0@lo:400:kworker.0 Request processed in 36us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364972.556946:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787364972.556958:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787364972.556964:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714111744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.557004:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714111744:12345-0@lo:400:kworker.0 Request processed in 41us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364972.557010:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787364972.557032:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787364972.557038:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d34241880, transno 4294967310 00000004:00080000:0.0:1787364972.557046:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1787364972.557065:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714111744:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.557086:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787364972.557090:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787364972.557102:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d409d5c00, transno 4294967304 00000100:00100000:0.0:1787364972.557112:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714111488:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.557153:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714111232 00000100:00100000:0.0:1787364972.557157:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714111232 00000100:00100000:0.0:1787364972.557177:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714111616 00000100:00100000:0.0:1787364972.557180:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714111616 00000100:00100000:0.0:1787364972.557195:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787364972.557200:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714111232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.557236:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714111232:12345-0@lo:400:kworker.0 Request processed in 35us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364972.557242:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787364972.557254:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787364972.557260:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714111616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.557286:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714111616:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364972.557292:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787364972.557307:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714111104 00000100:00100000:0.0:1787364972.557315:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714111104 00000100:00100000:0.0:1787364972.557343:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787364972.557349:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714111104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.557376:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714111104:12345-0@lo:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364972.557383:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787364972.557422:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714111104:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.557433:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714111616:0@lo:400:kworker.0 00000100:00100000:0.0:1787364972.557442:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714111232:0@lo:400:kworker.0 00000100:00080000:2.0:1787364972.558593:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364972.558601:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787364972.558604:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364973.067198:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787364973.067223:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714111872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364973.067303:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364973.067597:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714111872 00000100:00100000:2.0:1787364973.067606:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714111872 00000100:00100000:2.0:1787364973.067666:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787364973.067675:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714111872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364973.067711:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364973.067780:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714111872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364973.067807:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787364973.067924:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714111872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364973.068129:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787364973.068147:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714112000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364973.068190:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364973.068357:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714112000 00000100:00100000:2.0:1787364973.068362:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714112000 00000100:00100000:2.0:1787364973.068397:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787364973.068405:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714112000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787364973.068430:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364973.068471:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714112000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364973.068477:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787364973.068608:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714112000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787364973.132612:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364974.157616:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364974.703633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364974.703736:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688933888 00000100:00100000:0.0:1787364974.703746:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688933888 00000100:00100000:0.0:1787364974.703861:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 135 00000100:00100000:0.0:1787364974.703874:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+13:10245:x1874187688933888:12345-192.168.204.2@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787364974.703998:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+13:10245:x1874187688933888:12345-192.168.204.2@tcp:60:lhsmtool_posix.0 Request processed in 127us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364974.704006:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 135 00000100:00080000:2.0:1787364974.704747:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364974.709910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364974.710209:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688934144 00000100:00100000:2.0:1787364974.710223:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688934144 00000100:00100000:2.0:1787364974.710297:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:2.0:1787364974.710310:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+13:10245:x1874187688934144:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787364974.712852:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:10245:x1874187688934144:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 2527us (2940us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787364974.712870:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:3.0:1787364975.017072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364975.017277:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688934272 00000100:00100000:0.0:1787364975.017290:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688934272 00000100:00100000:0.0:1787364975.017393:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 136 00000100:00100000:0.0:1787364975.017406:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:11046:x1874187688934272:12345-192.168.204.2@tcp:101:lsof.0 00010000:00010000:0.0:1787364975.017453:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364975.017482:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b7be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd25 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364975.017571:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364975.017589:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364975.017606:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364975.017957:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787364975.017962:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:2.0:1787364975.018208:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1787364975.019290:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364975.019349:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b7be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364975.019386:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364975.019397:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:0.0:1787364975.019400:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787364975.019404:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879600, rc 0) 00000100:00100000:0.0:1787364975.019504:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:11046:x1874187688934272:12345-192.168.204.2@tcp:101:lsof.0 Request processed in 2100us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364975.019513:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 136 00010000:00010000:0.0:1787364975.180170:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364975.387982:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364975.388043:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364975.388097:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364975.388151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364975.388189:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688934656 00000100:00100000:3.0:1787364975.388203:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688934656 00000100:00080000:1.0:1787364975.388348:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787364975.388589:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688934528 00000100:00100000:3.0:1787364975.388593:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688934784 00000100:00100000:2.0:1787364975.388594:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688934528 00000100:00100000:3.0:1787364975.388596:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688934784 00000100:00100000:3.0:1787364975.388631:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 91 00000100:00100000:2.0:1787364975.388633:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 160 00000100:00100000:2.0:1787364975.388644:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:2365:x1874187688934528:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364975.388712:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2365:x1874187688934656:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364975.388757:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2365:x1874187688934656:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 48us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364975.388766:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 91 00000100:00100000:3.0:1787364975.388830:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 92 00000100:00100000:3.0:1787364975.388837:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688934784:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364975.388920:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688934400 00000100:00100000:0.0:1787364975.388925:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688934400 00000100:00100000:0.0:1787364975.388972:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 300 00000100:00100000:0.0:1787364975.388980:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2365:x1874187688934400:12345-192.168.204.2@tcp:400:kworker.0 00000100:00080000:1.0:1787364975.391530:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787364975.396620:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:2365:x1874187688934528:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 7956us (8510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364975.396642:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 160 00000100:00100000:3.0:1787364975.398814:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688934784:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 9944us (10629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364975.398838:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 92 00000100:00100000:0.0:1787364975.401716:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2365:x1874187688934400:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 12645us (13659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364975.401737:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 300 00010000:00010000:1.0:1787364976.203300:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787364976.706352:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1787364976.706405:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787364976.706490:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787364976.706504:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787364977.228110:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364977.675744:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714112384:0@lo:400:kworker.0 00000100:00100000:1.0:1787364977.675881:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364977.675971:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787364977.675978:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714112512:0@lo:400:kworker.0 00000100:00100000:1.0:1787364977.676008:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364977.676068:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714112512 00000100:00100000:1.0:1787364977.676078:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714112512 00000100:00100000:1.0:1787364977.676146:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787364977.676157:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714112512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364977.676216:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714112512:12345-0@lo:400:kworker.0 Request processed in 62us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364977.676225:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1787364977.676249:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364977.676291:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714112512:0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.679224:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714112128:0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.679346:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364977.679427:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714112640:0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.679462:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364977.679496:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787364977.679504:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714112256:0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.679528:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364977.679547:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714112768:0@lo:400:kworker.0 00000100:00100000:1.0:1787364977.679548:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714112128 00000100:00100000:1.0:1787364977.679561:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714112128 00000100:00100000:3.0:1787364977.679594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364977.679618:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787364977.679628:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714112128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.679652:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714112768 00000100:00100000:3.0:1787364977.679656:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714112768 00000100:00100000:1.0:1787364977.679693:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714112128:12345-0@lo:400:kworker.0 Request processed in 67us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364977.679698:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787364977.679700:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787364977.679705:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714112768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.679737:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714112768:12345-0@lo:400:kworker.0 Request processed in 33us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364977.679744:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1787364977.679762:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787364977.679818:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714112768:0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.679831:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714112128:0@lo:400:kworker.0 00000100:00100000:2.0:1787364977.679999:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714112384 00000100:00100000:2.0:1787364977.680005:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714112384 00000100:00100000:2.0:1787364977.680076:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714112640 00000100:00080000:1.0:1787364977.680077:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364977.680079:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714112640 00000100:00100000:2.0:1787364977.680100:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714112256 00000100:00100000:2.0:1787364977.680103:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714112256 00000100:00100000:1.0:1787364977.680103:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787364977.680110:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714112384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364977.680115:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787364977.680120:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714112640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364977.680154:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714112640:12345-0@lo:400:kworker.0 Request processed in 33us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364977.680154:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714112384:12345-0@lo:400:kworker.0 Request processed in 45us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364977.680161:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787364977.680164:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787364977.680176:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787364977.680182:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714112256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.680230:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714112640:0@lo:400:kworker.0 00000100:00100000:3.0:1787364977.680266:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714112384:0@lo:400:kworker.0 00000100:00100000:2.0:1787364977.680465:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714112256:12345-0@lo:400:kworker.0 Request processed in 283us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364977.680514:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714112256:0@lo:400:kworker.0 00000100:00080000:0.0:1787364977.681124:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787364977.688456:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787364978.189090:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787364978.189126:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714112896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364978.189231:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364978.189564:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3c7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714113024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364978.189596:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364978.192563:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714112896 00000100:00100000:2.0:1787364978.192584:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714112896 00000100:00100000:2.0:1787364978.192693:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714113024 00000100:00100000:2.0:1787364978.192697:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714113024 00000100:00100000:2.0:1787364978.192722:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787364978.192733:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714112896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364978.192837:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364978.192968:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714112896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 236us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364978.192976:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787364978.193029:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787364978.193046:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714113024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787364978.193071:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787364978.193106:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714113024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (3508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364978.193118:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787364978.193243:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3c7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714113024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364978.193266:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714112896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787364978.251334:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364979.295028:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787364980.204898:0:12329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:16:17 (1787364977) 00010000:00010000:1.0:1787364980.298932:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364980.524526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364980.524559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364980.524585:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364980.524605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364980.524627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364980.524800:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688935168 00000100:00100000:3.0:1787364980.524810:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688935168 00000100:00100000:3.0:1787364980.524865:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688935296 00000100:00100000:3.0:1787364980.524869:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688935296 00000100:00100000:3.0:1787364980.524892:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 95 00000100:00100000:3.0:1787364980.524902:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688935168:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364980.524977:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2366:x1874187688935168:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 76us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364980.525007:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 95 00000100:00100000:3.0:1787364980.525027:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 96 00000100:00100000:3.0:1787364980.525034:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688935296:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364980.525063:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688935296:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364980.525069:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 96 00000100:00100000:3.0:1787364980.525086:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688935424 00000100:00100000:3.0:1787364980.525091:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688935424 00000100:00100000:3.0:1787364980.525120:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688935040 00000100:00100000:3.0:1787364980.525123:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688935040 00000100:00100000:3.0:1787364980.525142:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 164 00000100:00100000:3.0:1787364980.525148:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2366:x1874187688935424:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364980.525188:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2366:x1874187688935424:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 40us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364980.525195:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 164 00000100:00100000:3.0:1787364980.525207:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 165 00000100:00100000:3.0:1787364980.525214:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+13:2366:x1874187688935040:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364980.525240:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+13:2366:x1874187688935040:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 25us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364980.525245:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 165 00000100:00100000:0.0:1787364980.527025:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688934912 00000100:00100000:0.0:1787364980.527037:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688934912 00000100:00100000:0.0:1787364980.527092:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 302 00000100:00100000:0.0:1787364980.527102:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2366:x1874187688934912:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364980.527180:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2366:x1874187688934912:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 79us (2678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364980.527187:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 302 00000100:00080000:0.0:1787364980.527220:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787364980.527225:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787364980.527228:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787364981.003354:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787364981.003368:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787364981.005626:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787364981.005644:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787364981.324341:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364981.883114:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364981.883670:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688935680 00000100:00100000:0.0:1787364981.883686:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688935680 00000100:00100000:0.0:1787364981.883774:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 137 00000100:00100000:0.0:1787364981.883830:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+13:11312:x1874187688935680:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364981.883859:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364981.883899:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2b7cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884021:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884041:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884055:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884073:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884080:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884087:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884706:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b7e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884722:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.884743:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364981.884756:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787364981.885054:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885065:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885074:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885083:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364981.885089:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885100:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885117:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d104f9700) 00010000:00010000:0.0:1787364981.885121:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364981.885128:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885136:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2b7d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885152:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885159:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885172:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885179:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364981.885182:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885190:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885199:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b6d3c6a8300) 00010000:00010000:0.0:1787364981.885202:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364981.885205:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885211:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2b7da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885772:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2b7cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd2c expref: 16 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885872:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd2c expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364981.885882:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:0.0:1787364981.885885:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364981.885888:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879800, rc 0) 00000100:00100000:0.0:1787364981.885992:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+15:11312:x1874187688935680:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 2207us (2892us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787364981.886013:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 137 00000100:00100000:2.0:1787364981.897843:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364981.898702:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688935808 00000100:00100000:3.0:1787364981.898718:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688935808 00000100:00100000:0.0:1787364981.899162:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 138 00000100:00100000:0.0:1787364981.899179:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+15:11312:x1874187688935808:12345-192.168.204.2@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787364981.899484:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+15:11312:x1874187688935808:12345-192.168.204.2@tcp:59:lhsmtool_posix.0 Request processed in 309us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364981.899495:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 138 00000100:00100000:1.0:1787364981.911002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364981.911128:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688935936 00000100:00100000:2.0:1787364981.911143:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688935936 00000100:00100000:2.0:1787364981.911236:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:2.0:1787364981.911248:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+15:2365:x1874187688935936:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364981.911271:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364981.911315:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2b7e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd2c expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364981.911339:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:2.0:1787364981.911345:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364981.911413:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+14:2365:x1874187688935936:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 167us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364981.911421:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00000040:00080000:3.0:1787364982.028132:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787364982.028147:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787364982.028893:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787364982.028909:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787364982.350602:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364982.795234:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714113408:0@lo:400:kworker.0 00000100:00100000:1.0:1787364982.795338:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364982.795422:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787364982.795429:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714113536:0@lo:400:kworker.0 00000100:00100000:1.0:1787364982.795464:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364982.795528:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714113408 00000100:00100000:1.0:1787364982.795538:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714113408 00000100:00100000:1.0:1787364982.795610:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787364982.795622:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714113408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364982.795684:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714113408:12345-0@lo:400:kworker.0 Request processed in 65us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364982.795691:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787364982.795717:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364982.795753:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714113408:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.796504:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714113152:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.796558:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364982.796596:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714113664:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.796624:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364982.796647:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787364982.796654:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714113280:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.796677:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364982.796698:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714113792:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.796723:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364982.796754:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714113536 00000100:00100000:3.0:1787364982.796760:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714113536 00000100:00100000:2.0:1787364982.799319:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714113664 00000100:00100000:2.0:1787364982.799342:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714113664 00000100:00100000:2.0:1787364982.799436:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714113280 00000100:00100000:2.0:1787364982.799440:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714113280 00000100:00100000:2.0:1787364982.799467:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787364982.799480:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714113664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364982.799637:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714113664:12345-0@lo:400:kworker.0 Request processed in 160us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364982.799645:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787364982.799666:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787364982.799673:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714113280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364982.799707:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714113280:12345-0@lo:400:kworker.0 Request processed in 35us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364982.799712:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787364982.799738:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714113152 00000100:00100000:2.0:1787364982.799742:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714113152 00000100:00100000:2.0:1787364982.799773:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787364982.799780:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714113152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364982.799836:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714113152:12345-0@lo:400:kworker.0 Request processed in 57us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364982.799842:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787364982.803629:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714113792 00000100:00100000:2.0:1787364982.803651:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714113792 00000100:00100000:2.0:1787364982.803807:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787364982.803823:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714113792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364982.803968:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714113792:12345-0@lo:400:kworker.0 Request processed in 149us (7242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364982.803977:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1787364982.804014:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787364982.804021:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787364982.804024:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787364982.805846:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714113280:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.805869:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714113792:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.805881:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714113152:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.805895:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714113664:0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.806008:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787364982.806024:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714113536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364982.806474:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714113536:12345-0@lo:400:kworker.0 Request processed in 454us (11006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364982.806506:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787364982.806600:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714113536:0@lo:400:kworker.0 00000100:00100000:3.0:1787364983.308002:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787364983.308036:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714113920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364983.308139:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364983.308422:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714113920 00000100:00100000:2.0:1787364983.308433:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714113920 00000100:00100000:2.0:1787364983.308495:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787364983.308505:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714113920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787364983.308563:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364983.308651:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714114048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787364983.308686:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364983.308736:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714114048 00000100:00100000:0.0:1787364983.308741:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714114048 00000100:00100000:0.0:1787364983.308769:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787364983.308777:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714114048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787364983.308825:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787364983.308890:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714114048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364983.308899:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787364983.308967:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714114048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364983.309081:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714113920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 575us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364983.309089:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787364983.309157:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714113920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787364983.372076:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364984.314482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364984.314737:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688936064 00000100:00100000:2.0:1787364984.314751:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688936064 00000100:00100000:2.0:1787364984.314870:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 139 00000100:00100000:2.0:1787364984.314883:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:11354:x1874187688936064:12345-192.168.204.2@tcp:101:lfs.0 00000100:00080000:1.0:1787364984.315013:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787364984.315056:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364984.315086:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b7ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd33 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315173:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315193:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315209:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315226:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315234:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315248:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315618:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315629:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315636:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315643:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364984.315649:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.315999:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316018:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:2.0:1787364984.316022:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364984.316028:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316036:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b7f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316049:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316055:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316069:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316074:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364984.316078:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316084:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316093:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b6d104f9400) 00010000:00010000:2.0:1787364984.316095:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364984.316098:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316104:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2b7fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316159:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b7ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd33 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316173:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:2.0:1787364984.316176:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364984.316179:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b7ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd33 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.316193:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448e00, rc 0) 00000100:00100000:3.0:1787364984.320108:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+14:11354:x1874187688936064:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 5207us (5618us total) trans 0 rc 301/301 00000100:00100000:3.0:1787364984.320127:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 139 00000100:00100000:3.0:1787364984.327574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364984.335851:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688936320 00000100:00100000:0.0:1787364984.335875:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688936320 00000100:00100000:0.0:1787364984.336113:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 140 00000100:00100000:0.0:1787364984.336128:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+14:11354:x1874187688936320:12345-192.168.204.2@tcp:36:lfs.0 00010000:00010000:0.0:1787364984.336215:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364984.336256:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2b16d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db6c expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.336278:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:0.0:1787364984.336302:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364984.336669:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.336687:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.336698:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.336741:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.336758:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 5 pid: 5856 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364984.336775:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714114176:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364984.336983:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c079c6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787364984.345036:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714114176:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364984.345112:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364984.351252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364984.357623:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688936448 00000100:00100000:0.0:1787364984.357645:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688936448 00010000:00010000:0.0:1787364984.357731:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 6 pid: 5856 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364984.357807:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 59 00000100:00100000:0.0:1787364984.357820:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2366:x1874187688936448:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364984.357843:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364984.357851:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 6 pid: 5856 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.357886:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 6 pid: 5856 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.358058:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2b7c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd25 expref: 6 pid: 5856 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.358076:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:0.0:1787364984.358082:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.358092:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.358101:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787364984.358200:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787364984.359199:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364984.359302:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2366:x1874187688936448:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 1477us (8061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364984.359316:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 59 00010000:00010000:2.0:1787364984.367975:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.367999:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.368049:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.368064:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.368077:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364984.372649:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787364984.372678:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.372692:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.372702:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.372709:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364984.372716:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.372725:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.372758:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d3c6a8c00) 00010000:00010000:2.0:1787364984.372761:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364984.372767:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.372775:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2b804 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787364984.374001:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d7b498b reply state 00000000741eb75e transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364984.374022:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787364984.374240:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+15:11354:x1874187688936320:12345-192.168.204.2@tcp:36:lfs.0 Request processed in 38108us (46673us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787364984.374252:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 140 00010000:00010000:1.0:1787364984.391716:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.391740:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.391749:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.391755:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364984.391761:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.391770:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.391822:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b6d104f9400) 00010000:00010000:1.0:1787364984.391826:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364984.391833:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.391856:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2b80b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.405564:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364984.499673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364984.500096:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688936576 00000100:00100000:3.0:1787364984.500112:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688936576 00000100:00100000:3.0:1787364984.500200:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 141 00000100:00100000:3.0:1787364984.500212:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+14:11362:x1874187688936576:12345-192.168.204.2@tcp:101:lctl.0 00010000:00010000:3.0:1787364984.500245:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364984.500278:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd3a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.500373:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b819 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.500391:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b819 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.500426:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b819 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364984.500517:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787364984.500521:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787364984.500556:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b819 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.500585:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd3a expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.500609:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b819 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd3a expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.500618:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:3.0:1787364984.500622:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787364984.500626:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030200, rc 0) 00000100:00100000:3.0:1787364984.501078:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+15:11362:x1874187688936576:12345-192.168.204.2@tcp:101:lctl.0 Request processed in 866us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364984.501088:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 141 00000100:00100000:3.0:1787364984.557996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364984.558195:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688936704 00000100:00100000:2.0:1787364984.558211:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688936704 00000100:00100000:2.0:1787364984.558301:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 142 00000100:00100000:2.0:1787364984.558314:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+15:11368:x1874187688936704:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:2.0:1787364984.558343:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364984.558370:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd41 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558463:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558482:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558521:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558541:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558549:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558556:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558702:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558710:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558717:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364984.558757:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787364984.558761:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364984.558865:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558881:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558902:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558929:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558936:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364984.558941:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558949:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558963:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:2.0:1787364984.558966:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364984.558972:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558979:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b827 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.558996:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559003:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559009:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559014:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364984.559017:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559033:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559042:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b6d104f9a00) 00010000:00010000:2.0:1787364984.559044:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364984.559047:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559053:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b82e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559096:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2b820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd41 expref: 17 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559111:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd41 expref: 16 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.559118:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364984.559121:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787364984.559123:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448800, rc 0) 00000100:00100000:2.0:1787364984.559219:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+16:11368:x1874187688936704:12345-192.168.204.2@tcp:101:bash.0 Request processed in 908us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364984.559229:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 142 00000100:00100000:2.0:1787364984.563624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364984.563734:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688936960 00000100:00100000:3.0:1787364984.563749:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688936960 00000100:00100000:3.0:1787364984.563867:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 143 00000100:00100000:3.0:1787364984.563880:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+16:11368:x1874187688936960:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364984.563928:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364984.563958:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b83c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd48 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.564387:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.564408:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.564421:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.566387:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.566414:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.566428:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787364984.567124:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787364984.569619:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569645:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569658:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569698:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569722:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569730:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569736:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364984.569741:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569750:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569764:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364984.569767:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364984.569772:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.569779:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2b843 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364984.569813:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffecdc2f reply state 000000002b78d3ab transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364984.569823:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787364984.571385:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2b83c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 19 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.571413:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.571442:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29a00) 00010000:00010000:3.0:1787364984.571445:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787364984.571449:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:2.0:1787364984.571642:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+19:11368:x1874187688936960:12345-192.168.204.2@tcp:101:bash.0 Request processed in 7754us (8023us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787364984.571657:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 143 00010000:00010000:3.0:1787364984.578464:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.578488:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.578498:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.578506:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364984.578513:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.578522:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.578544:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364984.578548:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364984.578554:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.578562:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b84a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364984.579047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364984.579108:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688937088 00000100:00100000:3.0:1787364984.579122:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688937088 00000100:00100000:3.0:1787364984.579287:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00100000:3.0:1787364984.579299:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:2365:x1874187688937088:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364984.579324:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364984.579350:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd4f expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787364984.579383:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787364984.579424:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1787364984.579429:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364984.579442:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.579463:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.579478:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030e00, rc 0) 00000100:00100000:3.0:1787364984.579563:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688937088:12345-192.168.204.2@tcp:101:bash.0 Request processed in 265us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364984.579571:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00080000:1.0:1787364984.579733:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364984.582383:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364984.582657:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688937216 00000100:00100000:3.0:1787364984.582671:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688937216 00000100:00100000:3.0:1787364984.582824:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:3.0:1787364984.582837:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+6:11368:x1874187688937216:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364984.582863:0:12088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364984.582888:0:12088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd56 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.582962:0:12088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.582972:0:12088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364984.582977:0:12088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364984.582983:0:12088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 7 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.583049:0:12088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.583067:0:12088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 7 pid: 6707 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364984.583085:0:12088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12088:1874187714114304:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364984.583211:0:12088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364984.586330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364984.586754:0:12088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12088:1874187714114304:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364984.586848:0:12088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 7 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.586878:0:12088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030600, rc 0) 00000100:00100000:0.0:1787364984.586978:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+7:11368:x1874187688937216:12345-192.168.204.2@tcp:101:bash.0 Request processed in 4143us (4610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364984.587012:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:1.0:1787364984.589136:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688937344 00000100:00100000:1.0:1787364984.589157:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688937344 00010000:00010000:1.0:1787364984.589300:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 7 pid: 6707 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364984.589423:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 60 00000100:00100000:1.0:1787364984.589435:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688937344:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364984.589456:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364984.589490:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 7 pid: 6707 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.589507:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 7 pid: 6707 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.589537:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055c3a255/0xcfc9272e5fc2b85f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd4f expref: 7 pid: 6707 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.589558:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364984.589564:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364984.589574:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.589605:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.589657:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364984.589675:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d45c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874187714114432:192.168.204.2@tcp:105: 00000100:00100000:1.0:1787364984.589906:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d187d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787364984.595322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364984.595391:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688937600 00000100:00100000:2.0:1787364984.595405:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688937600 00000100:00100000:1.0:1787364984.595460:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d45c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874187714114432:192.168.204.2@tcp:105: 00000100:00100000:2.0:1787364984.595480:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 36 00010000:00010000:1.0:1787364984.595489:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364984.595491:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+18:11368:x1874187688937600:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:1.0:1787364984.595569:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688937344:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 6135us (9254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364984.595580:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 60 00000100:00100000:2.0:1787364984.595973:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+19:11368:x1874187688937600:12345-192.168.204.2@tcp:35:bash.0 Request processed in 483us (667us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787364984.595981:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 36 00000100:00100000:3.0:1787364984.679109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364984.679684:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688937856 00000100:00100000:2.0:1787364984.679699:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688937856 00000100:00100000:2.0:1787364984.679819:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 144 00000100:00100000:2.0:1787364984.679833:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+19:11378:x1874187688937856:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364984.679867:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364984.679897:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b86d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd5d expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364984.680072:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787364984.680242:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b86d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd5d expref: 21 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.680260:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:2.0:1787364984.680264:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787364984.680269:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b86d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd5d expref: 21 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.680287:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448c00, rc 0) 00000100:00100000:2.0:1787364984.680503:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+20:11378:x1874187688937856:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 672us (1409us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787364984.680530:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 144 00000100:00100000:1.0:1787364984.688938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364984.689173:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688938112 00000100:00100000:2.0:1787364984.689186:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688938112 00000100:00100000:2.0:1787364984.689349:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:2.0:1787364984.689363:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+20:11378:x1874187688938112:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:2.0:1787364984.689744:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+21:11378:x1874187688938112:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 382us (821us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787364984.689754:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:1.0:1787364984.774127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364984.774382:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688938240 00000100:00100000:2.0:1787364984.774404:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688938240 00000100:00100000:2.0:1787364984.774625:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 145 00000100:00100000:2.0:1787364984.774638:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+21:11384:x1874187688938240:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364984.774672:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364984.774701:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b87b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd64 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.774832:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.774851:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.774867:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364984.774972:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787364984.774977:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364984.775030:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.775063:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b87b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd64 expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.775085:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd64 expref: 22 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.775095:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364984.775099:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787364984.775103:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449400, rc 0) 00000100:00100000:2.0:1787364984.775397:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+22:11384:x1874187688938240:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 752us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364984.775406:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 145 00000100:00100000:3.0:1787364984.780533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364984.781714:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688938496 00000100:00100000:0.0:1787364984.781732:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688938496 00000100:00100000:0.0:1787364984.781851:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 146 00000100:00100000:0.0:1787364984.781864:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+22:11384:x1874187688938496:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787364984.781902:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364984.781940:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878400/0xcfc9272e5fc2b889 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd6b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.782083:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2b890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.782102:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2b890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.782116:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2b890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364984.782130:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787364984.782318:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878400/0xcfc9272e5fc2b889 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd6b expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.782341:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2b890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd6b expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.782351:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29a00) 00010000:00010000:0.0:1787364984.782354:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364984.782358:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40878800, rc 0) 00000100:00100000:0.0:1787364984.782475:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+24:11384:x1874187688938496:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 614us (1959us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787364984.782484:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 146 00000100:00100000:1.0:1787364984.787939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364984.788142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688938624 00000100:00100000:0.0:1787364984.788155:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688938624 00000100:00100000:0.0:1787364984.788259:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:0.0:1787364984.788271:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+24:2367:x1874187688938624:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364984.788305:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364984.788340:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2b890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd6b expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.788366:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29a00) 00010000:00010000:0.0:1787364984.788372:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364984.788458:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+23:2367:x1874187688938624:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 189us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364984.788466:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:1.0:1787364984.796263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364984.796427:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688938880 00000100:00100000:0.0:1787364984.796441:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688938880 00000100:00100000:0.0:1787364984.796548:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 147 00000100:00100000:0.0:1787364984.796560:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+23:11384:x1874187688938880:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787364984.796594:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364984.796622:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2b89e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd72 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.796758:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879a00/0xcfc9272e5fc2b8a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.796777:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879a00/0xcfc9272e5fc2b8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.797014:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879a00/0xcfc9272e5fc2b8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364984.797031:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787364984.797422:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2b89e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd72 expref: 26 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.797444:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879a00/0xcfc9272e5fc2b8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd72 expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.797455:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29a00) 00010000:00010000:0.0:1787364984.797458:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787364984.797463:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879a00, rc 0) 00000100:00100000:0.0:1787364984.797589:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+25:11384:x1874187688938880:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1031us (1341us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787364984.797599:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 147 00000100:00100000:0.0:1787364984.808149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364984.808264:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688939008 00000100:00100000:3.0:1787364984.808278:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688939008 00000100:00100000:3.0:1787364984.808365:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:3.0:1787364984.808378:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2365:x1874187688939008:12345-192.168.204.2@tcp:1:lfs.0 00010000:00010000:3.0:1787364984.808471:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.808496:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.808506:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787364984.808511:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787364984.808516:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.808562:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.808579:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 6 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364984.808597:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6710:1874187714114560:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364984.808733:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364984.812604:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364984.812729:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688939136 00000100:00100000:1.0:1787364984.812742:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688939136 00002000:00100000:1.0:1787364984.812875:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b6d40a98700 x1874187688939136/t0(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:645/0 lens 504/0 e 0 to 0 dl 1787364995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364984.812899:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d40a98700 with x1874187688939136 ext(0->12) 00010000:00010000:1.0:1787364984.812919:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 7 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.812965:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 7 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787364984.812976:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d40a98700 00000100:00100000:1.0:1787364984.813007:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:1.0:1787364984.813018:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688939136:12345-192.168.204.2@tcp:4:lfs.0 00000100:00100000:1.0:1787364984.814066:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+9:2366:x1874187688939136:12345-192.168.204.2@tcp:4:lfs.0 Request processed in 1039us (1468us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787364984.814080:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 2 00002000:00100000:1.0:1787364984.814092:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b6d40a98700 x1874187688939136/t4294967305(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:645/0 lens 504/448 e 0 to 0 dl 1787364995 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364984.814103:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d40a98700 with x1874187688939136 ext(0->12) 00010000:00010000:1.0:1787364984.814113:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 9 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.814132:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 9 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787364984.814140:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d40a98700 00000100:00100000:3.0:1787364984.814294:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6710:1874187714114560:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364984.814328:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364984.817965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364984.818401:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688939264 00000100:00100000:1.0:1787364984.818416:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688939264 00010000:00010000:1.0:1787364984.818474:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 9 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364984.818555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00100000:1.0:1787364984.818567:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:2367:x1874187688939264:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364984.818590:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787364984.818616:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787364984.818619:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787364983 00002000:00010000:1.0:1787364984.818623:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787364983 00002000:00010000:1.0:1787364984.818626:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787364983 00010000:00010000:1.0:1787364984.818634:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 9 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.818650:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 9 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.818684:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2b866 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd56 expref: 9 pid: 12088 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.818707:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364984.818713:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364984.818721:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.818734:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.819098:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364984.819194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688939264:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 627us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364984.819204:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 61 00010000:00010000:3.0:1787364984.821274:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.821489:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.821542:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.821552:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.821563:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.821571:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364984.821576:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.821587:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.821613:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.821622:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044a5b33a/0xcfc9272e5fc2b8b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364984.822054:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688939008:12345-192.168.204.2@tcp:1:lfs.0 Request processed in 13668us (13909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364984.822067:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:2.0:1787364984.825591:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364984.825674:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688939520 00000100:00100000:3.0:1787364984.825687:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688939520 00000100:00100000:3.0:1787364984.825761:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 38 00000100:00100000:3.0:1787364984.825773:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d05539850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+25:11384:x1874187688939520:12345-192.168.204.2@tcp:35:lfs.0 00000004:00010000:3.0:1787364984.826053:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879a00/0xcfc9272e5fc2b8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd72 expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787364984.826562:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787364984.826616:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787364984.828604:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787364984.828712:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.828737:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.828748:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.828998:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364984.829033:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 29 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364984.829053:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874187714114688:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364984.829221:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787364984.834681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364984.835315:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688939648 00000100:00100000:0.0:1787364984.835328:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688939648 00010000:00010000:0.0:1787364984.835398:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 30 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364984.835450:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 62 00000100:00100000:0.0:1787364984.835462:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+30:2367:x1874187688939648:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364984.835484:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364984.835492:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 30 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.835525:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 30 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.835555:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29a00) 00010000:00010000:0.0:1787364984.835562:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.835574:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.835583:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364984.835610:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364984.835701:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+30:2367:x1874187688939648:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 241us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364984.835711:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 62 00010000:00010000:1.0:1787364984.837152:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd48 expref: 29 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364984.837378:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874187714114688:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364984.837507:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.837521:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.837527:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787364984.837712:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787364984.838270:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787364984.838586:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d46300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714114816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787364984.838680:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364984.838846:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33c95000 going to sleep for 11 seconds 00000100:00100000:2.0:1787364984.839023:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714114816 00000100:00100000:2.0:1787364984.839033:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714114816 00000100:00100000:2.0:1787364984.839145:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787364984.839157:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714114816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787364984.839279:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714114816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364984.839297:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787364984.839469:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d46300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714114816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787364984.840256:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787364984.840373:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40147800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714114944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787364984.840445:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364984.840489:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364984.841012:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714114944 00000100:00100000:0.0:1787364984.841022:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714114944 00000100:00100000:0.0:1787364984.841077:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787364984.841088:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714114944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787364984.841410:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874187714114944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 322us (963us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787364984.841420:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787364984.841589:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40147800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714114944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787364984.841670:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787364984.841728:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.841741:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.841750:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.841770:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364984.841776:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.841837:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.841859:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29a00) 00010000:00010000:3.0:1787364984.841862:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787364984.841868:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.841875:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b8ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787364984.842479:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787364984.842648:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787364984.843208:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787364984.843224:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431072437648ns, next at 432072433256ns, rc = 0 00000001:00080000:2.0:1787364984.843234:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787364984.843305:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29a00) 00010000:00010000:2.0:1787364984.843309:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787364984.843322:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879a00/0xcfc9272e5fc2b8a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd72 expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364984.843474:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d05539850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+32:11384:x1874187688939520:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 17701us (17896us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787364984.843485:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 38 00000020:00080000:2.0:1787364984.843505:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787364984.847259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364984.847417:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688939776 00000100:00100000:3.0:1787364984.847431:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688939776 00000100:00100000:3.0:1787364984.847506:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 148 00000100:00100000:3.0:1787364984.847519:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+32:11384:x1874187688939776:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:3.0:1787364984.847553:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364984.847585:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b8c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd79 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.847666:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd79 expref: 33 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.847685:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd79 expref: 33 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.847731:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:3.0:1787364984.847735:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787364984.847739:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031600, rc 0) 00000100:00100000:3.0:1787364984.847834:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+33:11384:x1874187688939776:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 319us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364984.847842:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 148 00000100:00100000:1.0:1787364984.852298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364984.852519:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688940032 00000100:00100000:2.0:1787364984.852531:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688940032 00000100:00100000:2.0:1787364984.852605:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:2.0:1787364984.852618:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+33:11384:x1874187688940032:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:2.0:1787364984.852970:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+34:11384:x1874187688940032:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 353us (685us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787364984.852980:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:0.0:1787364984.942654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364984.942858:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688940288 00000100:00100000:1.0:1787364984.942870:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688940288 00000100:00100000:1.0:1787364984.942978:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 149 00000100:00100000:1.0:1787364984.942991:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+34:11394:x1874187688940288:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364984.943026:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364984.943058:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b8c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364984.943249:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787364984.943428:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b8c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd80 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.943447:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:1.0:1787364984.943450:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787364984.943456:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b8c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd80 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364984.943474:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0400, rc 0) 00000100:00100000:1.0:1787364984.944040:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+35:11394:x1874187688940288:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1049us (1397us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787364984.944051:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 149 00000100:00100000:0.0:1787364984.947756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364984.947867:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688940416 00000100:00100000:3.0:1787364984.947880:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688940416 00000100:00100000:3.0:1787364984.947978:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 150 00000100:00100000:3.0:1787364984.947990:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+35:11394:x1874187688940416:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:3.0:1787364984.948098:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948121:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948138:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948157:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948165:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948185:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948309:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948333:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948341:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364984.948406:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948424:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948432:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948440:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948447:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364984.948451:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948460:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948474:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364984.948477:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364984.948482:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948489:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2b8d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948515:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948521:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948527:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948532:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364984.948535:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948540:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948548:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364984.948551:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364984.948554:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948564:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b8dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948582:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948588:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948592:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948603:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364984.948605:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948611:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948619:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:3.0:1787364984.948622:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364984.948625:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364984.948630:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b8e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364984.949026:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+35:11394:x1874187688940416:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 1036us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364984.949037:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 150 00000100:00100000:2.0:1787364984.951849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364984.952259:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688940672 00000100:00100000:0.0:1787364984.952292:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688940672 00000100:00100000:0.0:1787364984.952410:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 40 00000100:00100000:0.0:1787364984.952424:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+35:11394:x1874187688940672:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787364984.952831:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+36:11394:x1874187688940672:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 409us (994us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787364984.952841:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 40 00000100:00100000:0.0:1787364985.001131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.001287:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688940928 00000100:00100000:2.0:1787364985.001300:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688940928 00000100:00100000:2.0:1787364985.001396:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 151 00000100:00100000:2.0:1787364985.001409:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+36:11397:x1874187688940928:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364985.001445:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364985.001479:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2b8eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd87 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.001593:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.001613:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.001627:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.001645:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.001675:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.001682:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002287:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002299:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002307:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364985.002320:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787364985.002486:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002495:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002504:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002511:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364985.002517:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002526:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002565:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364985.002569:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364985.002576:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002583:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b8f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002602:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002609:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002614:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002620:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364985.002623:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002630:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002638:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9a00) 00010000:00010000:2.0:1787364985.002640:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364985.002643:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002649:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b8f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002735:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2b8eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002750:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.002759:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:2.0:1787364985.002762:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364985.002765:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449c00, rc 0) 00000100:00100000:2.0:1787364985.003449:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+38:11397:x1874187688940928:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 2038us (2327us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787364985.003464:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 151 00000100:00100000:2.0:1787364985.007046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364985.007151:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688941056 00000100:00100000:3.0:1787364985.007166:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688941056 00000100:00100000:3.0:1787364985.007343:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 152 00000100:00100000:3.0:1787364985.007357:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+38:11397:x1874187688941056:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:3.0:1787364985.007478:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007504:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007521:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007588:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007596:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007604:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007612:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364985.007617:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007627:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007643:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:3.0:1787364985.007647:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787364985.007654:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.007662:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b90e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364985.007891:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+38:11397:x1874187688941056:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 528us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364985.007907:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 152 00000100:00100000:1.0:1787364985.011061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.011232:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688941312 00000100:00100000:2.0:1787364985.011245:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688941312 00000100:00100000:2.0:1787364985.011317:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:2.0:1787364985.011330:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+38:11397:x1874187688941312:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:2.0:1787364985.011688:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+39:11397:x1874187688941312:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 360us (642us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787364985.011697:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:0.0:1787364985.277925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364985.278134:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688941568 00000100:00100000:1.0:1787364985.278148:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688941568 00000100:00100000:1.0:1787364985.278228:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 153 00000100:00100000:1.0:1787364985.278240:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+39:11428:x1874187688941568:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:1.0:1787364985.278274:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364985.278303:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b915 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.278687:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b91c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.278707:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b91c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.278741:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b91c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364985.278755:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787364985.279187:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b915 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd8e expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.279212:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b91c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd8e expref: 41 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.279221:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:1.0:1787364985.279225:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364985.279229:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0c00, rc 0) 00000100:00100000:1.0:1787364985.279322:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+41:11428:x1874187688941568:12345-192.168.204.2@tcp:101:cat.0 Request processed in 1084us (1413us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787364985.279332:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 153 00000100:00100000:1.0:1787364985.284781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.284931:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688941824 00000100:00100000:2.0:1787364985.284944:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688941824 00000100:00100000:2.0:1787364985.285018:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:2.0:1787364985.285030:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+41:11428:x1874187688941824:12345-192.168.204.2@tcp:35:cat.0 00000100:00100000:2.0:1787364985.285385:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+42:11428:x1874187688941824:12345-192.168.204.2@tcp:35:cat.0 Request processed in 357us (619us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787364985.286774:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:3.0:1787364985.289613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364985.289710:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688941952 00000100:00100000:1.0:1787364985.289723:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688941952 00000100:00100000:1.0:1787364985.289843:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:1.0:1787364985.289856:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+42:2367:x1874187688941952:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364985.289887:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364985.289930:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b91c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd8e expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.289953:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:1.0:1787364985.289977:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364985.290044:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+41:2367:x1874187688941952:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 190us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364985.290053:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:3.0:1787364985.348995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.349165:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688942208 00000100:00100000:2.0:1787364985.349177:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688942208 00000100:00100000:2.0:1787364985.349253:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 154 00000100:00100000:2.0:1787364985.349266:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+41:11434:x1874187688942208:12345-192.168.204.2@tcp:101:dd.0 00010000:00010000:2.0:1787364985.349301:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364985.349305:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787364985.349342:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd64 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.349367:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364985.349375:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787364985.349498:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b92a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd95 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.349634:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.349652:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.349662:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.349704:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.349720:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 41 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364985.349756:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714115072:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364985.350002:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b1e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364985.353974:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714115072:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364985.354018:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364985.362964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.363111:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688942336 00000100:00100000:2.0:1787364985.363124:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688942336 00010000:00010000:2.0:1787364985.363191:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 42 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364985.363245:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 63 00000100:00100000:2.0:1787364985.363257:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+42:2367:x1874187688942336:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364985.363280:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364985.363288:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 42 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.363305:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 42 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.363333:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b900 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd87 expref: 42 pid: 5857 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.363354:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:2.0:1787364985.363360:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.363371:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.363393:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.363422:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364985.363510:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+41:2367:x1874187688942336:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 254us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364985.363518:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 63 00010000:00010000:0.0:1787364985.364525:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.364540:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364985.364569:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787364985.364828:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2b92a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.364851:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.364860:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:0.0:1787364985.364864:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787364985.364867:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448a00, rc 0) 00000100:00100000:0.0:1787364985.364967:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+41:11434:x1874187688942208:12345-192.168.204.2@tcp:101:dd.0 Request processed in 15702us (15987us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787364985.364978:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 154 00000100:00100000:3.0:1787364985.368581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364985.368951:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688942592 00000100:00100000:1.0:1787364985.368964:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688942592 00000100:00100000:1.0:1787364985.369039:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 155 00000100:00100000:1.0:1787364985.369051:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+41:11434:x1874187688942592:12345-192.168.204.2@tcp:36:dd.0 00010000:00010000:1.0:1787364985.369443:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.369465:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.369480:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787364985.369542:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787364985.369567:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064964641 reply state 0000000011eb63ff transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364985.369577:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364985.369768:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+44:11434:x1874187688942592:12345-192.168.204.2@tcp:36:dd.0 Request processed in 717us (1200us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787364985.369777:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 155 00000020:00080000:1.0:1787364985.369818:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787364985.376156:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.376190:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.376218:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.376226:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364985.376232:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.376242:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.376264:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:1.0:1787364985.376268:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364985.376274:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.376282:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b93f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.420398:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364985.622508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.622885:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688942720 00000100:00100000:2.0:1787364985.622907:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688942720 00000100:00100000:2.0:1787364985.622995:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 156 00000100:00100000:2.0:1787364985.623007:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+43:11448:x1874187688942720:12345-192.168.204.2@tcp:101:stat.0 00010000:00010000:2.0:1787364985.623040:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364985.623067:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b946 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dd9c expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623164:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623182:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623196:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623214:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623223:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623250:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623375:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623386:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623396:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623504:0:8228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.623521:0:8228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 44 pid: 5856 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364985.623537:0:8228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714115200:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364985.623672:0:8228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b1ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787364985.624854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364985.624906:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364985.624938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364985.624974:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688942848 00000100:00100000:3.0:1787364985.624981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364985.624984:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688942848 00000100:00100000:0.0:1787364985.625043:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 304 00000100:00100000:0.0:1787364985.625055:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688942848:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364985.625133:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688942848:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364985.625141:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 304 00000100:00100000:1.0:1787364985.625265:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688943104 00000100:00100000:1.0:1787364985.625270:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688943104 00000100:00100000:1.0:1787364985.625320:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688942976 00000100:00100000:1.0:1787364985.625323:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688942976 00000100:00100000:1.0:1787364985.625347:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 99 00000100:00100000:1.0:1787364985.625354:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688943104:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364985.625393:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+6:2364:x1874187688943104:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 40us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364985.625400:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 99 00000100:00100000:1.0:1787364985.625424:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 100 00000100:00100000:1.0:1787364985.625432:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688942976:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364985.625475:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688942976:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 45us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364985.625481:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 100 00000100:00100000:1.0:1787364985.625504:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688943232 00000100:00100000:1.0:1787364985.625508:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688943232 00000100:00100000:1.0:1787364985.625535:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 169 00000100:00100000:1.0:1787364985.625542:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688943232:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364985.625571:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2364:x1874187688943232:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364985.625578:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 169 00000100:00080000:0.0:1787364985.625863:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787364985.630761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.631703:0:8228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714115200:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364985.631742:0:8228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364985.632600:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688943488 00000100:00100000:0.0:1787364985.632612:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688943488 00000100:00100000:0.0:1787364985.632694:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:0.0:1787364985.632705:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+45:5606:x1874187688943488:12345-192.168.204.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787364985.633354:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+46:5606:x1874187688943488:12345-192.168.204.2@tcp:35:ldlm_bl.0 Request processed in 647us (2605us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787364985.633365:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:1.0:1787364985.638862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364985.641248:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688943616 00000100:00100000:0.0:1787364985.641269:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688943616 00010000:00010000:0.0:1787364985.641343:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 46 pid: 5856 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364985.641549:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00100000:0.0:1787364985.641562:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+46:2366:x1874187688943616:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364985.641609:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364985.641619:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 46 pid: 5856 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.641638:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 46 pid: 5856 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.641667:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448a00/0xcfc9272e5fc2b931 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd95 expref: 46 pid: 5856 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.641689:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:0.0:1787364985.641695:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.641706:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.641714:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.641760:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364985.642901:0:8228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.642919:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364985.642987:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787364985.642993:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787364985.643030:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643050:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643062:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643069:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643078:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643085:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364985.643091:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643113:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643130:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364985.643133:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364985.643139:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643146:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2b94d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643177:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643185:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643191:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643197:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364985.643200:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643206:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643213:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9a00) 00010000:00010000:3.0:1787364985.643216:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364985.643219:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643237:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2b954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643295:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2b946 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd9c expref: 46 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643312:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd9c expref: 45 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.643320:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:3.0:1787364985.643323:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787364985.643325:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449800, rc 0) 00000100:00100000:0.0:1787364985.643449:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+45:2366:x1874187688943616:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 1887us (4599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364985.643463:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00100000:3.0:1787364985.647695:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+44:11448:x1874187688942720:12345-192.168.204.2@tcp:101:stat.0 Request processed in 24668us (25181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364985.647713:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 156 00000100:00100000:3.0:1787364985.737644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364985.737988:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688943872 00000100:00100000:0.0:1787364985.738001:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688943872 00000100:00100000:0.0:1787364985.738083:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 157 00000100:00100000:0.0:1787364985.738094:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+44:11454:x1874187688943872:12345-192.168.204.2@tcp:36:truncate.0 00010000:00010000:0.0:1787364985.738199:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364985.738236:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2b95b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd9c expref: 44 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364985.738260:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:0.0:1787364985.739203:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364985.741219:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.741251:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364985.741280:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787364985.741348:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787364985.741375:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d3fede6 reply state 00000000cd630e3e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364985.741385:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364985.741568:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+46:11454:x1874187688943872:12345-192.168.204.2@tcp:36:truncate.0 Request processed in 3470us (3936us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787364985.741578:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 157 00000020:00080000:1.0:1787364985.741601:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787364985.745630:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.745654:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.745663:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.745669:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364985.745675:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.745711:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.745732:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:3.0:1787364985.745735:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364985.745740:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364985.745747:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2b962 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364985.894440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.894600:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688944000 00000100:00100000:2.0:1787364985.894613:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688944000 00000100:00100000:2.0:1787364985.894701:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 158 00000100:00100000:2.0:1787364985.894714:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+45:11468:x1874187688944000:12345-192.168.204.2@tcp:101:stat.0 00010000:00010000:2.0:1787364985.894780:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364985.894928:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dda3 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895025:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895043:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895058:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895075:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895083:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895089:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895221:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895229:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.895235:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364985.895933:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787364985.895954:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364985.895991:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896008:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896019:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896026:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896034:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896041:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364985.896047:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896056:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896070:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364985.896074:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364985.896079:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896087:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b970 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896106:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896123:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896130:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896135:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364985.896139:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896146:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896154:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9600) 00010000:00010000:2.0:1787364985.896157:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364985.896160:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896167:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896217:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896233:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.896241:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:2.0:1787364985.896243:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364985.896252:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448c00, rc 0) 00000100:00100000:2.0:1787364985.896430:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+46:11468:x1874187688944000:12345-192.168.204.2@tcp:101:stat.0 Request processed in 1717us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364985.896441:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 158 00000100:00100000:1.0:1787364985.968063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364985.968178:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688944256 00000100:00100000:2.0:1787364985.968190:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688944256 00000100:00100000:2.0:1787364985.968268:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 159 00000100:00100000:2.0:1787364985.968279:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+46:11478:x1874187688944256:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364985.968308:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364985.968337:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddaa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364985.968669:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787364985.968859:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b985 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddaa expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.968959:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:2.0:1787364985.968962:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787364985.968971:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddaa expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364985.968991:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449200, rc 0) 00000100:00100000:2.0:1787364985.969134:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+47:11478:x1874187688944256:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 857us (1087us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787364985.969144:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 159 00000100:00100000:2.0:1787364985.977626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364985.977763:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688944512 00000100:00100000:0.0:1787364985.977777:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688944512 00000100:00100000:0.0:1787364985.978027:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:0.0:1787364985.978040:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d05538c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+47:11478:x1874187688944512:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787364985.978438:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d05538c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+48:11478:x1874187688944512:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 400us (828us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787364985.978448:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:0.0:1787364986.041991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364986.042398:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688944768 00000100:00100000:3.0:1787364986.042412:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688944768 00000100:00100000:3.0:1787364986.042509:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 160 00000100:00100000:3.0:1787364986.042525:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+48:11484:x1874187688944768:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364986.042559:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364986.042588:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b993 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddb1 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364986.042760:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364986.042779:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364986.042843:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364986.042919:0:8228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364986.042936:0:8228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 49 pid: 5857 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364986.042953:0:8228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40146300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714115328:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364986.043078:0:8228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12540 going to sleep for 11 seconds 00000100:00080000:0.0:1787364986.043312:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364986.049005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364986.049129:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688944896 00000100:00100000:1.0:1787364986.049141:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688944896 00010000:00010000:1.0:1787364986.049200:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 50 pid: 5857 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364986.049242:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 65 00000100:00100000:1.0:1787364986.049254:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+50:2366:x1874187688944896:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364986.049285:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364986.049293:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 50 pid: 5857 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.049308:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 50 pid: 5857 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.049336:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:1.0:1787364986.049342:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.049353:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.049361:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.049385:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364986.049473:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+50:2366:x1874187688944896:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 220us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364986.049481:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 65 00010000:00010000:2.0:1787364986.051510:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b97e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dda3 expref: 49 pid: 5857 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364986.051578:0:8228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40146300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714115328:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364986.051614:0:8228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.051625:0:8228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.051631:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364986.051663:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787364986.051979:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2b993 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 50 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.052001:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 49 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.052011:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:2.0:1787364986.052014:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787364986.052018:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:2.0:1787364986.052113:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+49:11484:x1874187688944768:12345-192.168.204.2@tcp:101:bash.0 Request processed in 9592us (10137us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787364986.052125:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 160 00000100:00100000:3.0:1787364986.070208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364986.070443:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688945152 00000100:00100000:1.0:1787364986.070457:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688945152 00000100:00100000:1.0:1787364986.070539:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 161 00000100:00100000:1.0:1787364986.070552:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+49:11484:x1874187688945152:12345-192.168.204.2@tcp:36:bash.0 00010000:00010000:1.0:1787364986.070986:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.071011:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.071026:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787364986.071092:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787364986.071119:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d370a518 reply state 000000000a1713cc transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364986.071130:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787364986.071393:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+52:11484:x1874187688945152:12345-192.168.204.2@tcp:36:bash.0 Request processed in 841us (1197us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787364986.071402:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 161 00000020:00080000:1.0:1787364986.071408:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787364986.082448:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.082474:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.082482:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.082490:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364986.082524:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.082535:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.082560:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:1.0:1787364986.082563:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364986.082570:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.082577:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364986.083763:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364986.084007:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688945280 00000100:00100000:2.0:1787364986.084021:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688945280 00000100:00100000:2.0:1787364986.084101:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 162 00000100:00100000:2.0:1787364986.084113:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+51:11484:x1874187688945280:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:2.0:1787364986.084161:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364986.084189:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddb8 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.084318:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.084333:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 52 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.084342:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.084383:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 52 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.084398:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 52 pid: 8228 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364986.084416:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714115456:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364986.084533:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364986.086613:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34451500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714115456:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364986.086654:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364986.087114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364986.087275:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688945408 00000100:00100000:0.0:1787364986.087284:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688945408 00010000:00010000:0.0:1787364986.087334:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 53 pid: 8228 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364986.087380:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 66 00000100:00100000:0.0:1787364986.087405:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+53:2367:x1874187688945408:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364986.087759:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364986.087770:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 53 pid: 8228 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.087847:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 53 pid: 8228 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.087888:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2b99a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb1 expref: 53 pid: 8228 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.087913:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:0.0:1787364986.087923:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.087934:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.087943:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.087982:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364986.088064:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+52:2367:x1874187688945408:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 660us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364986.088073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 66 00010000:00010000:2.0:1787364986.088161:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.088172:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364986.088241:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787364986.088246:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364986.088274:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.088312:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb8 expref: 52 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.088329:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb8 expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.088336:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:2.0:1787364986.088340:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364986.088342:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449200, rc 0) 00000100:00100000:2.0:1787364986.088374:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+51:11484:x1874187688945280:12345-192.168.204.2@tcp:101:bash.0 Request processed in 4264us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364986.088382:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 162 00000100:00100000:3.0:1787364986.093494:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364986.093580:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688945664 00000100:00100000:0.0:1787364986.093594:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688945664 00000100:00100000:0.0:1787364986.093671:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:0.0:1787364986.093685:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+51:11484:x1874187688945664:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:0.0:1787364986.094066:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+52:11484:x1874187688945664:12345-192.168.204.2@tcp:35:bash.0 Request processed in 383us (586us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787364986.094075:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:3.0:1787364986.200438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364986.200583:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688945920 00000100:00100000:1.0:1787364986.200596:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688945920 00000100:00100000:1.0:1787364986.200681:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 163 00000100:00100000:1.0:1787364986.200694:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+52:11494:x1874187688945920:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364986.200731:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364986.200763:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddbf expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364986.200986:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787364986.201158:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddbf expref: 54 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.201178:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:1.0:1787364986.201182:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787364986.201189:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddbf expref: 54 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.201232:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1200, rc 0) 00000100:00100000:1.0:1787364986.201321:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+53:11494:x1874187688945920:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 630us (900us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787364986.201331:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 163 00000100:00100000:3.0:1787364986.204206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364986.204455:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688946048 00000100:00100000:2.0:1787364986.204470:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688946048 00000100:00100000:2.0:1787364986.204554:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 164 00000100:00100000:2.0:1787364986.204567:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+53:11494:x1874187688946048:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:2.0:1787364986.204674:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.204695:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.204709:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.204735:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.204742:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.204748:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205112:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205123:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205131:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787364986.205186:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205201:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205208:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205215:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205223:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364986.205228:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205247:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205402:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364986.205406:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364986.205412:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205420:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2b9cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205438:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205445:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205452:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205457:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364986.205460:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205466:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205473:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9600) 00010000:00010000:2.0:1787364986.205475:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364986.205478:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205495:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2b9d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205514:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205521:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205527:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205532:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364986.205535:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205542:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205550:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:2.0:1787364986.205553:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364986.205556:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.205562:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2b9d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364986.205719:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+53:11494:x1874187688946048:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 1150us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364986.205730:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 164 00000100:00100000:3.0:1787364986.215967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364986.217008:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688946304 00000100:00100000:0.0:1787364986.217024:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688946304 00000100:00100000:0.0:1787364986.217104:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:0.0:1787364986.217115:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+53:11494:x1874187688946304:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787364986.217525:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+54:11494:x1874187688946304:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 411us (1570us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787364986.217535:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:3.0:1787364986.259234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364986.259635:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688946560 00000100:00100000:1.0:1787364986.259648:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688946560 00000100:00100000:1.0:1787364986.259735:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 165 00000100:00100000:1.0:1787364986.259746:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+54:11497:x1874187688946560:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364986.259782:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364986.259854:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddc6 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.260145:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.260165:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.260180:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.260196:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.260204:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.260212:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.261944:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b9f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.261971:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.261984:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364986.262000:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787364986.262157:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262166:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262174:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262181:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364986.262186:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262195:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262210:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:1.0:1787364986.262214:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364986.262220:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262247:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2b9e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262277:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262284:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262290:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262295:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364986.262299:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262305:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262314:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d12906500) 00010000:00010000:1.0:1787364986.262317:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364986.262320:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262327:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2b9ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262389:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2b9e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddc6 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262407:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddc6 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.262433:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:1.0:1787364986.262436:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364986.262439:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0c00, rc 0) 00000100:00100000:1.0:1787364986.262545:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+56:11497:x1874187688946560:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 2799us (3324us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787364986.262556:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 165 00000100:00100000:3.0:1787364986.271766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364986.271869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364986.271982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688946816 00000100:00100000:0.0:1787364986.271995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688946816 00000100:00100000:0.0:1787364986.272083:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:0.0:1787364986.272094:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+56:2364:x1874187688946816:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364986.272121:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364986.272159:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2b9f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddc6 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.272183:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:0.0:1787364986.272191:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364986.272268:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+55:2364:x1874187688946816:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 175us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364986.272277:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:2.0:1787364986.272401:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688946688 00000100:00100000:2.0:1787364986.272406:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688946688 00000100:00100000:2.0:1787364986.272451:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 166 00000100:00100000:2.0:1787364986.272460:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+55:11497:x1874187688946688:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:2.0:1787364986.272541:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272558:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272570:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272606:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272614:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272622:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272628:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364986.272634:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272642:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272651:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:2.0:1787364986.272654:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787364986.272658:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.272682:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364986.272724:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+55:11497:x1874187688946688:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 266us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364986.272732:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 166 00000100:00100000:3.0:1787364986.278237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364986.278392:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688947072 00000100:00100000:0.0:1787364986.278405:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688947072 00000100:00100000:0.0:1787364986.278482:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00100000:0.0:1787364986.278493:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+55:11497:x1874187688947072:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787364986.278844:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+56:11497:x1874187688947072:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 350us (621us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787364986.279376:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00100000:3.0:1787364986.433518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364986.433825:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688947328 00000100:00100000:2.0:1787364986.433840:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688947328 00000100:00100000:2.0:1787364986.433938:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 167 00000100:00100000:2.0:1787364986.433951:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+56:11515:x1874187688947328:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:2.0:1787364986.433986:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364986.434015:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddcd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.434151:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.434169:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.434183:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364986.434197:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787364986.434378:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddcd expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.434403:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddcd expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.434448:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:2.0:1787364986.434451:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787364986.434455:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448000, rc 0) 00000100:00100000:2.0:1787364986.435292:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+58:11515:x1874187688947328:12345-192.168.204.2@tcp:101:cat.0 Request processed in 1336us (1781us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787364986.435303:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 167 00010000:00010000:2.0:1787364986.443963:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364986.457758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364986.458103:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688947456 00000100:00100000:0.0:1787364986.458117:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688947456 00000100:00100000:2.0:1787364986.458342:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 168 00000100:00100000:2.0:1787364986.458358:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+58:11516:x1874187688947456:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364986.458395:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364986.458424:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddd4 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.458517:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2ba26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.458535:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2ba26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.458549:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2ba26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364986.458628:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787364986.458632:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364986.458657:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2ba26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.458689:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddd4 expref: 60 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.458730:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2ba26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddd4 expref: 59 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.458739:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364986.458742:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787364986.458746:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448c00, rc 0) 00000100:00100000:2.0:1787364986.459237:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+59:11516:x1874187688947456:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 881us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364986.459246:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 168 00000100:00100000:0.0:1787364986.462685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364986.462817:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688947840 00000100:00100000:2.0:1787364986.462829:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688947840 00000100:00100000:2.0:1787364986.462905:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:2.0:1787364986.462917:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+59:11516:x1874187688947840:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:2.0:1787364986.463824:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+60:11516:x1874187688947840:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 860us (1104us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787364986.463837:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:0.0:1787364986.466462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364986.466593:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688947968 00000100:00100000:1.0:1787364986.466607:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688947968 00000100:00100000:1.0:1787364986.466696:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:1.0:1787364986.466708:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+60:11516:x1874187688947968:12345-192.168.204.2@tcp:103:lfs.0 00010000:00010000:1.0:1787364986.466727:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787364986.466760:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2b9b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddb8 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.466997:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddcd expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.467014:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2b8c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd79 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364986.467030:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29d00) 00010000:00010000:1.0:1787364986.467044:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364986.467111:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+57:11516:x1874187688947968:12345-192.168.204.2@tcp:103:lfs.0 Request processed in 406us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364986.467120:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:3.0:1787364986.469503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364986.469701:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688948096 00000100:00100000:2.0:1787364986.469715:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688948096 00000100:00100000:2.0:1787364986.469819:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 169 00000100:00100000:2.0:1787364986.469831:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+57:11516:x1874187688948096:12345-192.168.204.2@tcp:58:lfs.0 00010000:00010000:2.0:1787364986.470030:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.470052:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.470080:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787364986.470368:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787364986.470859:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+57:11516:x1874187688948096:12345-192.168.204.2@tcp:58:lfs.0 Request processed in 1017us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364986.470881:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 169 00000100:00100000:0.0:1787364986.502190:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364986.509906:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688948224 00000100:00100000:2.0:1787364986.509928:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688948224 00000100:00100000:2.0:1787364986.510037:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 170 00000100:00100000:2.0:1787364986.510051:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+57:11518:x1874187688948224:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364986.510079:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364986.510113:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2ba34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dddb expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510207:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510224:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510237:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510267:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510274:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510305:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510449:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510458:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510466:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364986.510515:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787364986.510521:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364986.510543:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510557:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510566:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510573:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510581:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510587:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364986.510593:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510609:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510626:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364986.510629:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364986.510636:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510643:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2ba3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510662:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510667:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510674:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510679:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364986.510682:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510688:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510695:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9a00) 00010000:00010000:2.0:1787364986.510699:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364986.510701:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510716:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2ba42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510757:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2ba34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510772:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364986.510781:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d104f9600) 00010000:00010000:2.0:1787364986.510833:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787364986.510837:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448000, rc 0) 00000100:00100000:2.0:1787364986.510942:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+58:11518:x1874187688948224:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 894us (8772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364986.510950:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 170 00000001:00080000:2.0:1787364986.970563:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:2.0:1787364986.970633:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1787364986.970657:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787364986.970687:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d02ed1d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787364986.970693:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6c04984b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d02ed1300 00000020:00080000:2.0:1787364986.970696:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6c04984200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d40ab5400 00000020:00080000:2.0:1787364986.970887:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787364986.971118:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787364986.971635:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787364986.971660:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714115584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787364986.971756:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364986.971954:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714115584 00000100:00100000:0.0:1787364986.971964:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714115584 00000100:00100000:0.0:1787364986.972040:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787364986.972051:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714115584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787364986.972088:0:6710:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787364986.972144:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a890677, atime: 0x6a890677, ctime: 0x6a890677, blocks: 0x1 00010000:00010000:0.0:1787364986.972155:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.972175:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=433s v=(0 0) 00010000:00010000:0.0:1787364986.972180:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364986.972187:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.972208:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.972219:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.972226:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.972254:0:6710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787364986.972899:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714115584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 847us (1140us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787364986.972908:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787364986.972943:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787364986.972960:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364986.972968:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.972979:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878000 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787364986.972984:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.972995:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.973016:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.973024:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2ba50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364986.973044:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364986.973045:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787364986.973047:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787364986.973313:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d4079c000/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787364986.973322:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714115584:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1787364987.149965:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787364987.149975:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787364987.150138:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787364987.150153:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787364987.150344:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40adf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714115712:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787364987.150688:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c05f866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364987.156684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.156731:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688948352 00000100:00100000:3.0:1787364987.156742:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688948352 00000100:00100000:3.0:1787364987.156976:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 171 00000100:00100000:3.0:1787364987.156990:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688948352:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787364987.157039:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787364987.157213:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688948352:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 226us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.157223:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 171 00000100:00100000:1.0:1787364987.158589:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40adf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714115712:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787364987.162674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.163102:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688948480 00000100:00100000:2.0:1787364987.163117:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688948480 00000100:00100000:2.0:1787364987.163197:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 172 00000100:00100000:2.0:1787364987.163207:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+16:11529:x1874187688948480:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787364987.163680:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163703:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163721:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163739:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163745:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163751:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163816:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163825:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163833:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364987.163904:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787364987.163909:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364987.163927:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163940:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163947:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163955:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163962:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364987.163967:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163977:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.163991:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:2.0:1787364987.163994:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364987.164001:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164007:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2ba57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164018:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164036:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164043:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164048:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364987.164051:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164057:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164064:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b6d104f9a00) 00010000:00010000:2.0:1787364987.164067:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364987.164070:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164076:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2ba5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164094:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164101:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164108:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164113:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364987.164121:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164139:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164147:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d104f9600) 00010000:00010000:2.0:1787364987.164150:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364987.164153:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.164158:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2ba65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364987.164276:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+16:11529:x1874187688948480:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 Request processed in 1067us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.164286:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 172 00000100:00100000:3.0:1787364987.169410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.169460:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688948736 00000100:00100000:3.0:1787364987.169473:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688948736 00000100:00100000:3.0:1787364987.169547:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 173 00000100:00100000:3.0:1787364987.169562:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+16:11529:x1874187688948736:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787364987.169591:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364987.169621:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dde2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.169764:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.169802:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.169829:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364987.169866:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787364987.170143:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170152:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170159:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170166:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364987.170171:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170180:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170195:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d104f9600) 00010000:00010000:3.0:1787364987.170199:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787364987.170205:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170212:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170261:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba6c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dde2 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170285:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:3.0:1787364987.170288:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787364987.170293:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dde2 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.170304:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030600, rc 0) 00000100:00100000:3.0:1787364987.170389:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688948736:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 830us (1007us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787364987.170398:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 173 00000100:00100000:3.0:1787364987.174250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.174540:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688948864 00000100:00100000:2.0:1787364987.174554:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688948864 00000100:00100000:2.0:1787364987.174632:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 174 00000100:00100000:2.0:1787364987.174642:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688948864:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787364987.174691:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787364987.174870:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688948864:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 228us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.174879:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 174 00000100:00100000:3.0:1787364987.178711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364987.180020:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688949120 00000100:00100000:0.0:1787364987.180047:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688949120 00000100:00100000:0.0:1787364987.180226:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 175 00000100:00100000:0.0:1787364987.180251:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688949120:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364987.180277:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364987.180281:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787364987.180316:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2ba26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddd4 expref: 17 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.180336:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:0.0:1787364987.180342:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364987.180357:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2ba81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dde9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787364987.185370:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787364987.186055:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2ba88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.186078:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.186094:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.187310:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2ba81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dde9 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.187341:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2ba88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dde9 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.187368:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8200) 00010000:00010000:0.0:1787364987.187372:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364987.187376:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40878a00, rc 0) 00000100:00100000:0.0:1787364987.187693:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+18:11529:x1874187688949120:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 7453us (8994us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787364987.187702:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 175 00000100:00100000:3.0:1787364987.192165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.192231:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688949376 00000100:00100000:3.0:1787364987.192245:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688949376 00000100:00100000:3.0:1787364987.192320:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 176 00000100:00100000:3.0:1787364987.192333:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+18:11529:x1874187688949376:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787364987.192429:0:8228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364987.192467:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2ba88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dde9 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.192489:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8200) 00010000:00010000:3.0:1787364987.192502:0:8228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364987.192534:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.192551:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.192582:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.194041:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.194067:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.194078:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195067:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195084:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195092:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195099:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364987.195104:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195113:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195205:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364987.195210:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364987.195217:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195233:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2ba96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195248:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195255:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195260:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195265:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364987.195269:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195275:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195283:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd3bc1f61 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364987.195285:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364987.195288:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.195295:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2ba9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd3bc1f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364987.195553:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688949376:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 3211us (3394us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787364987.195565:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 176 00000100:00100000:3.0:1787364987.199403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364987.199453:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688949504 00000100:00100000:0.0:1787364987.199466:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688949504 00000100:00100000:0.0:1787364987.199544:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 177 00000100:00100000:0.0:1787364987.199556:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688949504:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787364987.199584:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364987.199618:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2baa4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.199668:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.199686:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.199700:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.199896:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2baa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 19 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.199915:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.199933:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:0.0:1787364987.199937:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787364987.199941:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40878000, rc 0) 00000100:00100000:0.0:1787364987.200021:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+18:11529:x1874187688949504:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 467us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364987.200030:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 177 00000100:00100000:0.0:1787364987.204092:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.204262:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688949760 00000100:00100000:2.0:1787364987.204277:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688949760 00000100:00100000:2.0:1787364987.204393:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 178 00000100:00100000:2.0:1787364987.204406:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+18:11529:x1874187688949760:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787364987.204542:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.204563:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.204577:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787364987.205027:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787364987.205041:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 433434254657ns, next at 434434250588ns, rc = 0 00000004:00010000:2.0:1787364987.205286:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d88a7eeb reply state 00000000c92e6beb transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364987.205299:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787364987.205435:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+20:11529:x1874187688949760:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 1030us (1356us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787364987.205445:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 178 00010000:00010000:3.0:1787364987.211662:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.211686:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.211695:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364987.211700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00010000:00010000:3.0:1787364987.211703:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364987.211709:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.211719:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.211741:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:3.0:1787364987.211745:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787364987.211752:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.211759:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bab2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364987.211874:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688949888 00000100:00100000:2.0:1787364987.211887:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688949888 00000100:00100000:2.0:1787364987.211956:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 179 00000100:00100000:2.0:1787364987.211969:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+20:11529:x1874187688949888:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364987.212000:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364987.212294:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.212383:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.212428:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.212455:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:2.0:1787364987.212458:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364987.212461:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449c00, rc 0) 00000100:00100000:2.0:1787364987.212544:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+21:11529:x1874187688949888:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 577us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.212553:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 179 00000100:00100000:0.0:1787364987.215013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364987.215161:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688950016 00000100:00100000:1.0:1787364987.215175:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688950016 00000100:00100000:1.0:1787364987.215307:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:1.0:1787364987.215319:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688950016:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787364987.215854:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688950016:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 535us (851us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787364987.215875:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00080000:0.0:1787364987.216104:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787364987.219568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.219687:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688950272 00000100:00100000:2.0:1787364987.219700:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688950272 00000100:00100000:2.0:1787364987.219935:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:2.0:1787364987.219950:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+20:11529:x1874187688950272:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787364987.220308:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+21:11529:x1874187688950272:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 361us (756us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787364987.220320:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:2.0:1787364987.223407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.223501:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688950528 00000100:00100000:3.0:1787364987.223514:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688950528 00000100:00100000:3.0:1787364987.223673:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 180 00000100:00100000:3.0:1787364987.223686:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+21:11529:x1874187688950528:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787364987.223883:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+21:11529:x1874187688950528:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 200us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.223913:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 180 00000100:00100000:1.0:1787364987.226392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.226556:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688950656 00000100:00100000:3.0:1787364987.226569:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688950656 00000100:00100000:3.0:1787364987.226685:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 181 00000100:00100000:3.0:1787364987.226696:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+21:11529:x1874187688950656:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787364987.226724:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364987.226752:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ddfe expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.226942:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.226965:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.226980:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364987.227035:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787364987.227060:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.227093:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddfe expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.227115:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddfe expref: 22 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.227126:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:3.0:1787364987.227137:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787364987.227142:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030600, rc 0) 00000100:00100000:3.0:1787364987.227223:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+22:11529:x1874187688950656:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 528us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.227232:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 181 00000100:00100000:1.0:1787364987.236135:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.236393:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688950784 00000100:00100000:2.0:1787364987.236407:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688950784 00000100:00100000:2.0:1787364987.236756:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 52 00000100:00100000:2.0:1787364987.236913:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:2367:x1874187688950784:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364987.236941:0:8229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364987.236970:0:8229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de05 expref: -99 pid: 8229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787364987.237035:0:8229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89067a, blocks: 0x1 00010000:00010000:2.0:1787364987.237066:0:8229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1787364987.237072:0:8229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364987.237082:0:8229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 8 pid: 8229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.237108:0:8229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 8 pid: 8229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.237125:0:8229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449800, rc 0) 00000100:00100000:2.0:1787364987.237254:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688950784:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 347us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.237263:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 52 00000100:00100000:0.0:1787364987.241028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.241086:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688951040 00000100:00100000:2.0:1787364987.241103:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688951040 00000100:00100000:2.0:1787364987.241180:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 182 00000100:00100000:2.0:1787364987.241191:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+22:11529:x1874187688951040:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787364987.241398:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+22:11529:x1874187688951040:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 208us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.241407:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 182 00000100:00100000:1.0:1787364987.246671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.246777:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688951168 00000100:00100000:2.0:1787364987.246817:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688951168 00000100:00100000:2.0:1787364987.246898:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:2.0:1787364987.246911:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:11529:x1874187688951168:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364987.246947:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364987.246978:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de0c expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.247022:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 9 pid: 8229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.247033:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364987.247038:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364987.247045:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.247091:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 9 pid: 8229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.247109:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 9 pid: 8229 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364987.247128:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34453b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6709:1874187714115840:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364987.247415:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b1ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787364987.250071:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34453b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6709:1874187714115840:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364987.250126:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.250154:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449400, rc 0) 00000100:00100000:2.0:1787364987.250880:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:11529:x1874187688951168:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 3325us (3579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.250896:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:1.0:1787364987.253481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.253646:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688951296 00000100:00100000:3.0:1787364987.253660:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688951296 00010000:00010000:3.0:1787364987.253715:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 9 pid: 8229 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364987.253775:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 67 00000100:00100000:3.0:1787364987.253970:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:2366:x1874187688951296:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364987.254110:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364987.254201:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 9 pid: 8229 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.254218:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 9 pid: 8229 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.254731:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000b24576/0xcfc9272e5fc2bace lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de05 expref: 9 pid: 8229 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.254752:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364987.254757:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787364987.254801:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.254814:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.254878:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364987.254894:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f84d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874187714115968:192.168.204.2@tcp:105: 00000100:00100000:1.0:1787364987.255006:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33c95780 going to sleep for 11 seconds 00000100:00100000:1.0:1787364987.267703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.268104:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688951424 00000100:00100000:3.0:1787364987.268119:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688951424 00002000:00100000:3.0:1787364987.268204:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b6d3f84ca80 x1874187688951424/t0(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:648/0 lens 504/0 e 0 to 0 dl 1787364998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787364987.268218:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d3f84ca80 with x1874187688951424 ext(0->8) 00002000:00010000:3.0:1787364987.268225:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d3f84ca80 00000100:00100000:3.0:1787364987.268271:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:3.0:1787364987.268281:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:2366:x1874187688951424:12345-192.168.204.2@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787364987.268915:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6b97b2b3-6991-434b-88a0-aee779536483+11:2366:x1874187688951424:12345-192.168.204.2@tcp:4:lhsmtool_posix.0 Request processed in 632us (1225us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787364987.268925:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 4 00002000:00100000:3.0:1787364987.268934:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b6d3f84ca80 x1874187688951424/t4294967314(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:648/0 lens 504/448 e 0 to 0 dl 1787364998 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787364987.268953:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d3f84ca80 with x1874187688951424 ext(0->8) 00002000:00010000:3.0:1787364987.268957:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d3f84ca80 00000100:00100000:2.0:1787364987.272096:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f84d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874187714115968:192.168.204.2@tcp:105: 00010000:00010000:2.0:1787364987.272129:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364987.272244:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+10:2366:x1874187688951296:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 18457us (18778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.272259:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 67 00000100:00100000:3.0:1787364987.275353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.276629:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688951552 00000100:00100000:2.0:1787364987.276646:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688951552 00000100:00100000:2.0:1787364987.276772:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 183 00000100:00100000:2.0:1787364987.276807:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+22:11529:x1874187688951552:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787364987.323939:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+22:11529:x1874187688951552:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 Request processed in 47138us (48584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.323956:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 183 00000001:00080000:2.0:1787364987.324053:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:2.0:1787364987.324069:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787364987.324078:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787364987.324097:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787364987.324331:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787364987.324344:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787364987.324365:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714116096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787364987.324434:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364987.324496:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714116096 00000100:00100000:2.0:1787364987.324505:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714116096 00000100:00100000:2.0:1787364987.324887:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787364987.324898:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714116096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787364987.325117:0:12088:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787364987.325121:0:12088:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787364986 00002000:00010000:2.0:1787364987.325124:0:12088:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787364987.325126:0:12088:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787364986 -> 1787364986 00002000:00010000:2.0:1787364987.325129:0:12088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787364987.325179:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714116096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 282us (743us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787364987.325187:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787364987.325209:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787364987.325325:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d34453b80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787364987.325332:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714116096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787364987.327779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.329583:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688951680 00000100:00100000:2.0:1787364987.329607:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688951680 00000100:00100000:2.0:1787364987.329686:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 55 00000100:00100000:2.0:1787364987.329696:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+10:2366:x1874187688951680:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787364987.395234:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1787364987.395262:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1787364987.395269:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1787364987.395958:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688951680:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 Request processed in 66253us (68194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.395971:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 55 00000100:00100000:0.0:1787364987.406522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.406749:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688951936 00000100:00100000:3.0:1787364987.406762:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688951936 00000100:00100000:3.0:1787364987.406877:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 184 00000100:00100000:3.0:1787364987.406889:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+18:11529:x1874187688951936:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787364987.406974:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364987.407014:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddfe expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.407037:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:3.0:1787364987.407044:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364987.407083:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.407100:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.407111:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364987.407488:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000893caced reply state 0000000063f2432e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364987.407500:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787364987.407637:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+19:11529:x1874187688951936:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 750us (1129us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787364987.407646:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 184 00000040:00080000:3.0:1787364987.421557:0:12479:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787364987.421573:0:12479:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787364987.421621:0:12479:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787364987.421628:0:12479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787364987.423348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00010000:00010000:1.0:1787364987.423508:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.423523:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.423533:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.423540:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364987.423547:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.423556:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.423580:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:1.0:1787364987.423595:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364987.423602:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.423609:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2badc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364987.423768:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688952064 00000100:00100000:2.0:1787364987.423782:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688952064 00000100:00100000:2.0:1787364987.423939:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 56 00000100:00100000:2.0:1787364987.423952:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2367:x1874187688952064:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787364987.425264:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787364987.425275:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787364986 -> 1787364985 00002000:00010000:2.0:1787364987.425279:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787364983 00002000:00010000:2.0:1787364987.425281:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787364986 -> 1787364985 00002000:00010000:2.0:1787364987.425284:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787364987.425377:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688952064:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 1424us (2040us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787364987.425403:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 56 00000100:00100000:1.0:1787364987.432620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.432699:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688952320 00000100:00100000:3.0:1787364987.432714:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688952320 00000100:00100000:3.0:1787364987.433117:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 185 00000100:00100000:3.0:1787364987.433135:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+18:11529:x1874187688952320:12345-192.168.204.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787364987.433237:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.433259:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.433272:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.433346:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.433362:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 18 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364987.433387:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07244a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714116224:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364987.433524:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364987.435768:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07244a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714116224:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364987.435829:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364987.438959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364987.439954:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688952448 00000100:00100000:2.0:1787364987.439970:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688952448 00010000:00010000:2.0:1787364987.440031:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 19 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364987.440976:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 68 00000100:00100000:2.0:1787364987.440996:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+19:2367:x1874187688952448:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364987.441019:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364987.441031:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 19 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.441050:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 19 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.441082:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878000/0xcfc9272e5fc2baab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf0 expref: 19 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.441103:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:2.0:1787364987.441111:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.441125:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.441136:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.441192:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364987.441276:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+18:2367:x1874187688952448:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 287us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.441286:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 68 00010000:00010000:1.0:1787364987.441422:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.441432:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.441472:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.441480:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.441488:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.441495:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364987.441501:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.441521:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.441531:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:1.0:1787364987.441534:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787364987.441538:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.441545:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bae3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364987.441597:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688952320:12345-192.168.204.2@tcp:55:lhsmtool_posix.0 Request processed in 8467us (8993us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787364987.441607:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 185 00000100:00100000:3.0:1787364987.449461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364987.449720:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688952576 00000100:00100000:0.0:1787364987.449733:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688952576 00000100:00100000:0.0:1787364987.449830:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00100000:0.0:1787364987.449861:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+8:2365:x1874187688952576:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787364987.449926:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.449953:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.449963:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364987.449968:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787364987.449974:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.450043:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.450058:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 8 pid: 6709 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364987.450077:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6710:1874187714116352:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364987.450196:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11600c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787364987.454076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364987.454492:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6710:1874187714116352:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364987.454528:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364987.454709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688952704 00000100:00100000:1.0:1787364987.454719:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688952704 00010000:00010000:1.0:1787364987.454770:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 9 pid: 6709 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364987.454846:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:1.0:1787364987.454865:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:2366:x1874187688952704:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364987.454887:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364987.454916:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 9 pid: 6709 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.454932:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 9 pid: 6709 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.454984:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2bad5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de0c expref: 9 pid: 6709 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.455002:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364987.455008:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364987.455014:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.455026:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.455054:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364987.455131:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688952704:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 265us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364987.455140:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 69 00010000:00010000:0.0:1787364987.455622:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.455635:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.455672:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.455681:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.455704:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.455712:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787364987.455716:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.455727:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.455742:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.455749:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061a747ff/0xcfc9272e5fc2baea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364987.455911:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688952576:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 Request processed in 6070us (6466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364987.455922:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00100000:3.0:1787364987.458074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00010000:00010000:2.0:1787364987.467552:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364987.467657:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688952960 00000100:00100000:0.0:1787364987.467672:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688952960 00000100:00100000:1.0:1787364987.467943:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 186 00000100:00100000:1.0:1787364987.467956:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+17:11529:x1874187688952960:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787364987.468067:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.468089:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.468103:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.468426:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.468438:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.468447:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.468492:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364987.468509:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 18 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364987.468526:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f84f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714116480:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364987.468645:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33c95a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787364987.479249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.482274:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688953088 00000100:00100000:3.0:1787364987.482298:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688953088 00010000:00010000:3.0:1787364987.482361:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 19 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364987.482413:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 70 00000100:00100000:3.0:1787364987.482425:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+19:2366:x1874187688953088:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364987.482446:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364987.482455:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 19 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.482471:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 19 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.482501:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:3.0:1787364987.482507:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.482518:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.482540:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.482568:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364987.482649:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+19:2366:x1874187688953088:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 227us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.482659:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 70 00010000:00010000:0.0:1787364987.482978:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bab9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ddf7 expref: 18 pid: 5858 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364987.482997:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f84f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714116480:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364987.483034:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.483044:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.483050:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787364987.483306:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787364987.483487:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787364987.483537:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787364987.483638:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4079c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874187714116608:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787364987.483732:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364987.483779:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d099f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364987.484850:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714116608 00000100:00100000:3.0:1787364987.484877:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714116608 00000100:00100000:3.0:1787364987.484947:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787364987.484957:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1874187714116608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787364987.485084:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1874187714116608:12345-0@lo:1000:mdt00_001.0 Request processed in 128us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.485092:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787364987.485348:0:5857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787364987.485356:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d34453b80, transno 4294967315 00000100:00100000:0.0:1787364987.485380:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d4079c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874187714116608:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787364987.486020:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787364987.487916:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c061c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874187714116736:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787364987.488020:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364987.488066:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d202aa300 going to sleep for 11 seconds 00000100:00100000:3.0:1787364987.488226:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714116736 00000100:00100000:3.0:1787364987.488236:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714116736 00000100:00100000:3.0:1787364987.488306:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787364987.488319:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1874187714116736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787364987.488627:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5857:x1874187714116736:12345-0@lo:1000:mdt00_001.0 Request processed in 310us (609us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787364987.488636:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787364987.488867:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c061c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874187714116736:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787364987.488924:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.488936:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.488960:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.488968:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364987.488973:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.488984:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489003:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8b00) 00010000:00010000:0.0:1787364987.489007:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787364987.489013:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489020:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2baf8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489060:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489067:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489073:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489078:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364987.489081:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489098:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489108:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d104f9600) 00010000:00010000:0.0:1787364987.489110:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787364987.489114:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489638:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2ba2d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489668:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489687:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489698:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489741:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.489760:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 21 pid: 5857 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364987.489776:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c061c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714116864:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364987.490035:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d202aa300 going to sleep for 11 seconds 00000100:00100000:3.0:1787364987.499867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364987.499915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688953216 00000100:00100000:3.0:1787364987.499926:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688953216 00010000:00010000:3.0:1787364987.499979:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 22 pid: 5857 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364987.500043:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 71 00000100:00100000:3.0:1787364987.500054:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07247480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+22:2366:x1874187688953216:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364987.500074:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364987.500082:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 22 pid: 5857 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.500097:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 22 pid: 5857 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.500139:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d104f9600) 00010000:00010000:3.0:1787364987.500146:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.500159:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.500168:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364987.500194:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364987.500256:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07247480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+22:2366:x1874187688953216:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 203us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.500266:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 71 00010000:00010000:0.0:1787364987.503450:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2ba49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dddb expref: 21 pid: 5857 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364987.503495:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c061c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874187714116864:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364987.503534:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503546:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503552:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503569:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503575:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503583:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503589:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364987.503595:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503603:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503623:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d104f9600) 00010000:00010000:0.0:1787364987.503626:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364987.503632:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503649:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2baff lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503661:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503667:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503674:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503679:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364987.503682:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503689:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503698:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d104f9600) 00010000:00010000:0.0:1787364987.503701:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787364987.503703:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.503711:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2baf1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364987.504757:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+20:11529:x1874187688952960:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 36792us (46686us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787364987.504775:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 186 00000020:00080000:0.0:1787364987.504825:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787364987.505342:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787364987.505350:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787364987.505893:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787364987.505903:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787364987.509715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364987.509829:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688953472 00000100:00100000:0.0:1787364987.509860:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688953472 00000100:00100000:0.0:1787364987.509930:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 50 00000100:00100000:0.0:1787364987.509943:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d05539050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+20:11529:x1874187688953472:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787364987.510778:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787364987.510943:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787364987.510998:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.511021:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.511035:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.511044:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.511051:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.511057:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364987.511087:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787364987.511210:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d05539050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+22:11529:x1874187688953472:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 1266us (1508us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787364987.511220:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 50 00000020:00080000:0.0:1787364987.511227:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787364987.513412:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787364987.513437:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.513450:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364987.513454:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.513465:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.513488:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d3c6a8900) 00010000:00010000:2.0:1787364987.513491:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787364987.513496:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.513503:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bb06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364987.513529:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364987.513532:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787364987.513533:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364987.915250:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714117120:0@lo:400:kworker.0 00000100:00100000:2.0:1787364987.915301:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714116992:0@lo:400:kworker.0 00000100:00100000:2.0:1787364987.915350:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364987.915350:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364987.915425:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714117632:0@lo:400:kworker.0 00000100:00100000:2.0:1787364987.915442:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714117504:0@lo:400:kworker.0 00000100:00100000:1.0:1787364987.915450:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364987.915465:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364987.915496:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714117120 00000100:00100000:2.0:1787364987.915498:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714117248:0@lo:400:kworker.0 00000100:00100000:1.0:1787364987.915505:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714117120 00000100:00100000:2.0:1787364987.915521:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364987.915540:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787364987.915545:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714117376:0@lo:400:kworker.0 00000100:00100000:1.0:1787364987.915557:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714117504 00000100:00100000:1.0:1787364987.915559:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714117504 00000100:00100000:2.0:1787364987.915569:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364987.915614:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714117248 00000100:00100000:3.0:1787364987.915619:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714117248 00000100:00100000:0.0:1787364987.917365:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714116992 00000100:00100000:0.0:1787364987.917397:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714116992 00000100:00100000:0.0:1787364987.917933:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787364987.917948:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714116992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364987.918074:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0799d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714116992:12345-0@lo:400:kworker.0 Request processed in 129us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364987.918082:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787364987.918153:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787364987.918165:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714117120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364987.918213:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714117120:12345-0@lo:400:kworker.0 Request processed in 50us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364987.918220:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787364987.918305:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714116992:0@lo:400:kworker.0 00000100:00100000:0.0:1787364987.918358:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714117120:0@lo:400:kworker.0 00000100:00100000:1.0:1787364987.922885:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787364987.922923:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714117504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364987.923103:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714117504:12345-0@lo:400:kworker.0 Request processed in 201us (7636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364987.923113:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787364987.925252:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787364987.925274:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714117248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364987.925392:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714117248:12345-0@lo:400:kworker.0 Request processed in 127us (9869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.925400:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787364987.925439:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714117632 00000100:00100000:3.0:1787364987.925449:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714117632 00000100:00100000:2.0:1787364987.925486:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714117248:0@lo:400:kworker.0 00000100:00100000:3.0:1787364987.925488:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714117376 00000100:00100000:3.0:1787364987.925492:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714117376 00000100:00100000:3.0:1787364987.925511:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787364987.925517:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1874187714117632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364987.925523:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787364987.925531:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4036a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714117376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364987.925556:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1874187714117632:12345-0@lo:400:kworker.0 Request processed in 39us (10104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364987.925563:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787364987.925563:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4036a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714117376:12345-0@lo:400:kworker.0 Request processed in 35us (9993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364987.925569:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787364987.925607:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714117376:0@lo:400:kworker.0 00000100:00080000:1.0:1787364987.926332:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787364987.931487:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714117504:0@lo:400:kworker.0 00000100:00100000:0.0:1787364987.931554:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714117632:0@lo:400:kworker.0 00000100:00100000:1.0:1787364988.427328:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787364988.427365:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714117760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787364988.427475:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364988.427642:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714117760 00000100:00100000:3.0:1787364988.427652:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714117760 00000100:00100000:3.0:1787364988.427744:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787364988.427757:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714117760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787364988.427842:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364988.427915:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714117760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364988.427925:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787364988.428002:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714117760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787364988.428355:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714117888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787364988.428395:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787364988.428474:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787364988.428532:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714117888 00000100:00100000:2.0:1787364988.428538:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714117888 00000100:00100000:2.0:1787364988.428579:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787364988.428588:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714117888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787364988.428604:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787364988.428652:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714117888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364988.428659:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787364988.428840:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714117888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787364988.491503:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787364989.024079:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787364989.024117:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:2.0:1787364989.419458:0:12531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787364989.419472:0:12531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787364989.419516:0:12531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787364989.419523:0:12531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787364989.516965:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787364989.541327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364989.541578:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688953728 00000100:00100000:1.0:1787364989.541593:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688953728 00000100:00100000:1.0:1787364989.541710:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 187 00000100:00100000:1.0:1787364989.541724:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+22:11548:x1874187688953728:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364989.541769:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1787364989.541959:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787364989.542058:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bb0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de13 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.542433:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2bb14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.542452:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2bb14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.542467:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2bb14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364989.542482:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787364989.542716:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bb0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de13 expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.542734:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2bb14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de13 expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.542744:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:1.0:1787364989.542747:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787364989.542752:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0600, rc 0) 00000100:00100000:0.0:1787364989.543179:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+24:11548:x1874187688953728:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1457us (1866us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787364989.543190:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 187 00000100:00100000:0.0:1787364989.546988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364989.547117:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688953856 00000100:00100000:1.0:1787364989.547132:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688953856 00000100:00100000:1.0:1787364989.547201:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 188 00000100:00100000:1.0:1787364989.547219:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+24:11548:x1874187688953856:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:1.0:1787364989.547329:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.547352:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.547366:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.547383:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.547391:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.547398:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548065:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548085:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548093:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364989.548148:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548163:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548170:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548177:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548184:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.548189:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548197:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548213:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364989.548216:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.548222:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548228:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bb22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548248:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548254:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548259:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548264:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.548267:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548274:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548282:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d12906500) 00010000:00010000:3.0:1787364989.548285:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.548288:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548294:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bb29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548310:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548317:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548323:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548333:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.548336:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548342:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548350:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364989.548353:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.548356:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.548362:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364989.548523:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+24:11548:x1874187688953856:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 1307us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364989.548534:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 188 00000100:00100000:1.0:1787364989.591280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.591429:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688954112 00000100:00100000:3.0:1787364989.591443:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688954112 00000100:00100000:3.0:1787364989.591523:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 189 00000100:00100000:3.0:1787364989.591535:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+24:11551:x1874187688954112:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:3.0:1787364989.591564:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364989.591590:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de1a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.591693:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.591725:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.591738:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.591754:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.591761:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.591767:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592371:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592380:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592388:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364989.592401:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787364989.592527:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592535:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592542:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592555:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.592561:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592569:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592584:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364989.592587:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.592593:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592600:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bb3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592620:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592626:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592632:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592636:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.592639:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592645:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592662:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364989.592677:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.592680:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592686:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592738:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592753:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 26 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.592761:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364989.592763:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787364989.592766:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031600, rc 0) 00000100:00100000:3.0:1787364989.594362:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+26:11551:x1874187688954112:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 2815us (3085us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787364989.594377:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 189 00000100:00100000:2.0:1787364989.599253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.599767:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688954240 00000100:00100000:3.0:1787364989.599964:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688954240 00000100:00100000:3.0:1787364989.600094:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 190 00000100:00100000:3.0:1787364989.600108:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+26:11551:x1874187688954240:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:3.0:1787364989.600205:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600226:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600248:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600284:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600292:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600300:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600306:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.600311:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600320:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600334:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364989.600337:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787364989.600343:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.600349:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364989.600464:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+26:11551:x1874187688954240:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 358us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364989.600473:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 190 00000100:00100000:0.0:1787364989.603038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364989.603170:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688954496 00000100:00100000:2.0:1787364989.603189:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688954496 00000100:00100000:2.0:1787364989.603264:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:2.0:1787364989.603278:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+26:11551:x1874187688954496:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:2.0:1787364989.603622:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+27:11551:x1874187688954496:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 346us (594us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787364989.603631:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:2.0:1787364989.645759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.645991:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688954752 00000100:00100000:3.0:1787364989.646019:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688954752 00000100:00100000:3.0:1787364989.646100:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 191 00000100:00100000:3.0:1787364989.646113:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+27:11077:x1874187688954752:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364989.646151:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364989.646181:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bb61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de21 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.646327:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.646345:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 28 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.646356:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.646399:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 28 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.646417:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 28 pid: 5858 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364989.646433:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07246a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714118016:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364989.646554:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787364989.665963:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.666042:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688954880 00000100:00100000:3.0:1787364989.666057:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688954880 00010000:00010000:3.0:1787364989.666119:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 29 pid: 5858 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364989.666178:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 72 00000100:00100000:3.0:1787364989.666190:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+29:2366:x1874187688954880:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364989.666211:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364989.666221:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 29 pid: 5858 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.666237:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 29 pid: 5858 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.666268:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364989.666275:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.666288:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.666296:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.666320:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364989.666399:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+29:2366:x1874187688954880:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 210us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364989.666409:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 72 00010000:00010000:3.0:1787364989.666609:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de1a expref: 28 pid: 5858 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364989.666629:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07246a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714118016:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787364989.666660:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.666671:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.666678:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364989.666704:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787364989.671365:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bb61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.671414:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.671426:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364989.671430:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787364989.671434:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:3.0:1787364989.671548:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+28:11077:x1874187688954752:12345-192.168.204.2@tcp:101:bash.0 Request processed in 25438us (25803us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787364989.671560:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 191 00000100:00100000:0.0:1787364989.679010:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.684571:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688955136 00000100:00100000:3.0:1787364989.684590:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688955136 00000100:00100000:3.0:1787364989.684680:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 192 00000100:00100000:3.0:1787364989.684693:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+28:11077:x1874187688955136:12345-192.168.204.2@tcp:36:bash.0 00010000:00010000:3.0:1787364989.686291:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.686341:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.686357:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787364989.686425:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787364989.686455:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009465e413 reply state 0000000098ba9c54 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364989.686466:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787364989.686521:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787364989.686666:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+32:11077:x1874187688955136:12345-192.168.204.2@tcp:36:bash.0 Request processed in 1969us (7786us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787364989.686675:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 192 00000020:00080000:3.0:1787364989.686683:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787364989.692138:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.692162:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.692171:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.692178:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.692184:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.692194:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.692240:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364989.692244:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.692251:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.692257:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364989.694101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.694349:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688955264 00000100:00100000:3.0:1787364989.694361:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688955264 00000100:00100000:3.0:1787364989.694445:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 193 00000100:00100000:3.0:1787364989.694458:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+31:11077:x1874187688955264:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787364989.694496:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364989.694525:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bb7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de28 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.694611:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bb7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de28 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.694628:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bb7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de28 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.694654:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364989.694658:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787364989.694663:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031c00, rc 0) 00000100:00100000:3.0:1787364989.694747:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+32:11077:x1874187688955264:12345-192.168.204.2@tcp:101:bash.0 Request processed in 292us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364989.694756:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 193 00000100:00100000:1.0:1787364989.698893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364989.698959:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688955392 00000100:00100000:0.0:1787364989.698973:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688955392 00000100:00100000:0.0:1787364989.699063:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 58 00000100:00080000:1.0:1787364989.699075:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787364989.699085:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:11077:x1874187688955392:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:0.0:1787364989.699111:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364989.699142:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de2f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787364989.699177:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a890679, atime: 0x6a890677, ctime: 0x6a890679, blocks: 0xb 00010000:00010000:0.0:1787364989.699208:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1787364989.699214:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364989.699224:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364989.699243:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364989.699258:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879a00, rc 0) 00000100:00100000:0.0:1787364989.699341:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+8:11077:x1874187688955392:12345-192.168.204.2@tcp:101:bash.0 Request processed in 267us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364989.699349:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 58 00000100:00100000:0.0:1787364989.706243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364989.706307:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688955520 00000100:00100000:1.0:1787364989.706319:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688955520 00002000:00010000:1.0:1787364989.706377:0:6715:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787364989.706383:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6c061c6d80 with x1874187688955520 ext(0->18446744073709551615) 00002000:00010000:1.0:1787364989.706398:0:6715:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6c061c6d80. 00000100:00100000:1.0:1787364989.706492:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:1.0:1787364989.706505:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688955520:12345-192.168.204.2@tcp:10:bash.0 00002000:00010000:1.0:1787364989.706948:0:6715:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787364989.706952:0:6715:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787364985 -> 1787364988 00002000:00010000:1.0:1787364989.706955:0:6715:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787364983 -> 1787364983 00002000:00010000:1.0:1787364989.706957:0:6715:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787364985 -> 1787364988 00002000:00010000:1.0:1787364989.706960:0:6715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787364989.707058:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6b97b2b3-6991-434b-88a0-aee779536483+9:2367:x1874187688955520:12345-192.168.204.2@tcp:10:bash.0 Request processed in 555us (829us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787364989.707069:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 5 00002000:00010000:1.0:1787364989.707074:0:6715:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787364989.707077:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6c061c6d80 with x1874187688955520 ext(0->18446744073709551615) 00002000:00010000:1.0:1787364989.707094:0:6715:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6c061c6d80. 00000100:00100000:1.0:1787364989.812764:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.813064:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688955648 00000100:00100000:3.0:1787364989.813078:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688955648 00000100:00100000:3.0:1787364989.813205:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 194 00000100:00100000:3.0:1787364989.813216:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+32:11565:x1874187688955648:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:3.0:1787364989.813316:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.813339:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.813356:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.813375:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.813383:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.813390:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.813758:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.813770:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.813778:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364989.813870:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814125:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814132:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814141:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814148:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.814153:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814163:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814178:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364989.814181:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.814187:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814194:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bb8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814209:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814216:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814223:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814235:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.814239:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814246:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814255:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364989.814258:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.814261:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814268:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bb92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814287:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814293:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814300:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814305:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364989.814309:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814315:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814332:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364989.814335:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364989.814338:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.814345:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bb99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364989.814461:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+32:11565:x1874187688955648:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 1242us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364989.814471:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 194 00000100:00100000:0.0:1787364989.851662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.851841:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688955904 00000100:00100000:3.0:1787364989.851854:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688955904 00000100:00100000:2.0:1787364989.852232:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 195 00000100:00100000:2.0:1787364989.852249:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+32:11568:x1874187688955904:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364989.852283:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364989.852313:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bba0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de36 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.852526:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.852544:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.852557:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.852576:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.852604:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.852611:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853257:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bbb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853271:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853279:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364989.853290:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787364989.853573:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853583:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853590:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853597:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364989.853601:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853610:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853641:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364989.853644:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364989.853650:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853657:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bba7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853673:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853680:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853686:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853692:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364989.853695:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853701:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853708:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9800) 00010000:00010000:2.0:1787364989.853711:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364989.853714:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.853720:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bbae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.854516:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bba0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de36 expref: 35 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.854543:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de36 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364989.854553:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:2.0:1787364989.854556:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787364989.854560:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449c00, rc 0) 00000100:00100000:2.0:1787364989.854656:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+34:11568:x1874187688955904:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 2411us (3008us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787364989.854667:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 195 00000100:00100000:1.0:1787364989.859499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364989.859774:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688956032 00000100:00100000:0.0:1787364989.859824:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688956032 00000100:00100000:0.0:1787364989.859926:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 196 00000100:00100000:0.0:1787364989.859938:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+34:11568:x1874187688956032:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:0.0:1787364989.860037:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364989.860060:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364989.860083:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364989.860129:0:8228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364989.860146:0:8228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 34 pid: 5856 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364989.860164:0:8228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c061c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714118144:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364989.860286:0:8228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d401133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364989.864016:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364989.864358:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688956288 00000100:00100000:2.0:1787364989.864370:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688956288 00000100:00100000:2.0:1787364989.864468:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 52 00000100:00100000:2.0:1787364989.864481:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+35:5606:x1874187688956288:12345-192.168.204.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787364989.864979:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+36:5606:x1874187688956288:12345-192.168.204.2@tcp:35:ldlm_bl.0 Request processed in 499us (974us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787364989.864988:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 52 00000100:00100000:0.0:1787364989.866642:0:8228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c061c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714118144:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364989.866687:0:8228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364989.868948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364989.869176:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688956416 00000100:00100000:3.0:1787364989.869188:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688956416 00010000:00010000:3.0:1787364989.869243:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 36 pid: 5856 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364989.869303:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 73 00000100:00100000:3.0:1787364989.869317:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+36:2367:x1874187688956416:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364989.869339:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364989.869348:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 36 pid: 5856 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.869365:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 36 pid: 5856 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.869395:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bb68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de21 expref: 36 pid: 5856 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.869444:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364989.869451:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.869462:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.869472:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364989.869498:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364989.869572:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+35:2367:x1874187688956416:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 257us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364989.869581:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 73 00010000:00010000:1.0:1787364989.871952:0:8228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.871998:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.872051:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.872060:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.872068:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.872152:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364989.872158:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.872168:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.872191:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:1.0:1787364989.872194:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787364989.872200:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364989.872207:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879400/0xcfc9272e5fc2bbc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364989.872380:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+34:11568:x1874187688956032:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 12438us (12891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364989.872402:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 196 00000100:00100000:0.0:1787364989.876219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364989.876339:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688956672 00000100:00100000:2.0:1787364989.876353:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688956672 00000100:00100000:2.0:1787364989.876428:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:2.0:1787364989.876439:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+34:11568:x1874187688956672:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:2.0:1787364989.876917:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+35:11568:x1874187688956672:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 479us (710us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787364989.876948:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:0.0:1787364990.044179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364990.044381:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688956928 00000100:00100000:3.0:1787364990.044395:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688956928 00000100:00100000:3.0:1787364990.044474:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 197 00000100:00100000:3.0:1787364990.044487:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+35:11579:x1874187688956928:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:3.0:1787364990.044582:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364990.044611:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bbca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de3d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.044717:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.044736:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.044750:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.044915:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.044926:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.044934:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.047440:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bbdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.047466:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.047481:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364990.047497:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787364990.052293:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.052309:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.052317:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.052325:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364990.052330:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.060256:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.060291:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364990.060295:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364990.060303:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.060313:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bbd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.060984:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.060998:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.061006:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.061013:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364990.061018:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.061026:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.061039:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364990.061043:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364990.061046:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.061084:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bbd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.062314:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bbca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de3d expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.062649:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bbdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de3d expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.062660:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:3.0:1787364990.062663:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787364990.062666:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030600, rc 0) 00000100:00100000:3.0:1787364990.062915:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+37:11579:x1874187688956928:12345-192.168.204.2@tcp:101:cat.0 Request processed in 18428us (18748us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787364990.062926:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 197 00000100:00100000:3.0:1787364990.068986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.070605:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688957184 00000100:00100000:2.0:1787364990.070629:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688957184 00000100:00100000:2.0:1787364990.070724:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 54 00000100:00100000:2.0:1787364990.070739:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+37:11579:x1874187688957184:12345-192.168.204.2@tcp:35:cat.0 00000100:00100000:2.0:1787364990.071148:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+38:11579:x1874187688957184:12345-192.168.204.2@tcp:35:cat.0 Request processed in 411us (2174us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787364990.071158:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 54 00000100:00100000:3.0:1787364990.094460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.094577:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688957440 00000100:00100000:0.0:1787364990.094597:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688957440 00000100:00100000:0.0:1787364990.094722:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 198 00000100:00100000:0.0:1787364990.094736:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+38:11580:x1874187688957440:12345-192.168.204.2@tcp:36:rm.0 00010000:00010000:0.0:1787364990.094872:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787364990.094910:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bbdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de3d expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.094938:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bbb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de36 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.094951:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bb7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de28 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.094966:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d10b29000) 00010000:00010000:0.0:1787364990.094980:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787364990.095011:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.095028:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.095038:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.095055:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.095062:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.095069:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.095588:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.095602:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.095609:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787364990.098778:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787364990.098837:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 436328050457ns, next at 437328045467ns, rc = 0 00010000:00010000:0.0:1787364990.098943:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.098966:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.098978:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.098989:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.098996:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099003:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099035:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787364990.099068:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099082:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099088:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099095:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364990.099100:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099109:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099127:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d3c6a8400) 00010000:00010000:0.0:1787364990.099131:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787364990.099138:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099145:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2bbfb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.099175:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787364990.099175:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099194:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.099199:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099205:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099240:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364990.099241:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364990.099248:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099253:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.099264:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099268:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099301:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:0.0:1787364990.099305:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787364990.099309:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.099320:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879e00/0xcfc9272e5fc2bbed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787364990.099342:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008fd5bc9 reply state 000000000e26276d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.099352:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d3c6a8400) 00000100:00100000:0.0:1787364990.099355:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787364990.099359:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787364990.099368:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.099377:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879800/0xcfc9272e5fc2bc02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.099408:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364990.099410:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364990.099412:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364990.101348:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+37:11580:x1874187688957440:12345-192.168.204.2@tcp:36:rm.0 Request processed in 6599us (6882us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787364990.101364:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 198 00010000:00010000:2.0:1787364990.103103:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.103121:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.103138:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.103146:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364990.103151:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.103159:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.103176:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d3c6a8000) 00010000:00010000:2.0:1787364990.103179:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364990.103183:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.103207:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878200/0xcfc9272e5fc2bbf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.166613:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.167378:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688957696 00000100:00100000:2.0:1787364990.167404:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688957696 00000100:00100000:2.0:1787364990.167493:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 199 00000100:00100000:2.0:1787364990.167506:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+36:11586:x1874187688957696:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:2.0:1787364990.167540:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364990.167571:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bc09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.167767:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.167858:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.167881:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.167901:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.167909:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.167917:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787364990.168640:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787364990.168887:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.168898:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.168907:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.168952:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.168961:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.168968:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.168975:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364990.168980:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.168990:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.169004:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364990.169008:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364990.169013:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.169021:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449e00/0xcfc9272e5fc2bc10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787364990.169046:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004597f666 reply state 00000000f7583c26 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364990.169056:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787364990.169098:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bc09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.169112:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.169120:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:2.0:1787364990.169122:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364990.169124:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449800, rc 0) 00000100:00100000:2.0:1787364990.169221:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+39:11586:x1874187688957696:12345-192.168.204.2@tcp:101:bash.0 Request processed in 1717us (2626us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787364990.169231:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 199 00010000:00010000:3.0:1787364990.172336:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.172356:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.172366:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.172372:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364990.172378:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.172394:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.172415:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9400) 00010000:00010000:3.0:1787364990.172418:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364990.172443:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.172451:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2bc17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.175349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.175542:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688957824 00000100:00100000:0.0:1787364990.175558:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688957824 00000100:00100000:0.0:1787364990.175666:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 59 00000100:00100000:0.0:1787364990.175679:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688957824:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:0.0:1787364990.175705:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364990.175736:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de4b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787364990.175774:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787364990.175861:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=436s v=(0 0) 00010000:00010000:0.0:1787364990.175868:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364990.175882:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.175908:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.175927:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879e00, rc 0) 00000100:00100000:0.0:1787364990.176014:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688957824:12345-192.168.204.2@tcp:101:bash.0 Request processed in 338us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364990.176024:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 59 00000100:00080000:1.0:1787364990.177045:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364990.181014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.181194:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688957952 00000100:00100000:2.0:1787364990.181207:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688957952 00000100:00100000:2.0:1787364990.181287:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 60 00000100:00100000:2.0:1787364990.181300:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+6:11586:x1874187688957952:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:2.0:1787364990.181327:0:12088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364990.181351:0:12088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de52 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.181394:0:12088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.181429:0:12088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364990.181435:0:12088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364990.181442:0:12088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 7 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.181490:0:12088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.181506:0:12088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 7 pid: 6707 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364990.181524:0:12088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f9f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12088:1874187714118272:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364990.181673:0:12088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98780 going to sleep for 11 seconds 00000100:00100000:1.0:1787364990.189354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.190624:0:12088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f9f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12088:1874187714118272:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787364990.190679:0:12088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 7 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.190708:0:12088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449e00, rc 0) 00000100:00100000:0.0:1787364990.190856:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+7:11586:x1874187688957952:12345-192.168.204.2@tcp:101:bash.0 Request processed in 9558us (9855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364990.190868:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 60 00000100:00100000:3.0:1787364990.191091:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688958080 00000100:00100000:3.0:1787364990.191101:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688958080 00010000:00010000:3.0:1787364990.191146:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 7 pid: 6707 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.191192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 74 00000100:00100000:3.0:1787364990.191204:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688958080:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364990.191222:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364990.191252:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 7 pid: 6707 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.191267:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 7 pid: 6707 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.191297:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2bc2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de4b expref: 7 pid: 6707 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.191315:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364990.191320:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364990.191330:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.191371:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.191422:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.191441:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07245180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874187714118400:192.168.204.2@tcp:105: 00000100:00100000:3.0:1787364990.191524:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c052d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787364990.195762:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07245180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874187714118400:192.168.204.2@tcp:105: 00010000:00010000:3.0:1787364990.195851:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364990.197229:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+6:2366:x1874187688958080:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 6014us (7876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364990.197246:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 74 00000100:00100000:1.0:1787364990.202283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364990.207394:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688958336 00000100:00100000:3.0:1787364990.207418:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688958336 00000100:00100000:3.0:1787364990.207523:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 55 00000100:00100000:3.0:1787364990.207537:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+38:11586:x1874187688958336:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:3.0:1787364990.208434:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+39:11586:x1874187688958336:12345-192.168.204.2@tcp:35:bash.0 Request processed in 895us (6161us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787364990.208445:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 55 00000100:00100000:1.0:1787364990.461910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364990.462106:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688958464 00000100:00100000:3.0:1787364990.462118:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688958464 00000100:00100000:3.0:1787364990.462191:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 200 00000100:00100000:3.0:1787364990.462202:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+39:11602:x1874187688958464:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:3.0:1787364990.462233:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364990.462260:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de59 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.462375:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bc41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.462394:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.462409:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364990.462976:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787364990.462982:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787364990.463015:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.463048:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de59 expref: 41 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.463073:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bc41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de59 expref: 40 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.463083:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364990.463086:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787364990.463091:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031600, rc 0) 00000100:00100000:3.0:1787364990.463180:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+40:11602:x1874187688958464:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 979us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364990.463189:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 200 00000100:00100000:2.0:1787364990.473192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.473309:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688958720 00000100:00100000:0.0:1787364990.473322:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688958720 00000100:00100000:0.0:1787364990.473402:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 201 00000100:00100000:0.0:1787364990.473414:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+40:11602:x1874187688958720:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787364990.473443:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364990.473487:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2bc48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.474080:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2bc4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.474100:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.474115:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364990.474129:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787364990.474300:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878600/0xcfc9272e5fc2bc48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de60 expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.474323:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2bc4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de60 expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.474334:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:0.0:1787364990.474337:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364990.474342:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40878a00, rc 0) 00000100:00100000:0.0:1787364990.474540:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+42:11602:x1874187688958720:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1127us (1361us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787364990.474549:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 201 00000100:00100000:1.0:1787364990.488524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.488712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364990.488890:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688959104 00000100:00100000:3.0:1787364990.488903:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688959104 00000100:00100000:0.0:1787364990.488962:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688958848 00000100:00100000:0.0:1787364990.488968:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688958848 00000100:00100000:3.0:1787364990.489006:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 202 00000100:00100000:3.0:1787364990.489021:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+43:11602:x1874187688959104:12345-192.168.204.2@tcp:101:lfs.0 00000100:00100000:0.0:1787364990.489028:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:0.0:1787364990.489040:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07003c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+43:2366:x1874187688958848:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364990.489053:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364990.489060:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364990.489101:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878a00/0xcfc9272e5fc2bc4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de60 expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.489123:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:0.0:1787364990.489130:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364990.489171:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de67 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364990.489202:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07003c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+43:2366:x1874187688958848:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 165us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364990.489212:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 15 00010000:00010000:3.0:1787364990.489303:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.489320:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.489332:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364990.489346:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787364990.489502:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de67 expref: 44 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.489521:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de67 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.489528:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:3.0:1787364990.489531:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787364990.489533:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030000, rc 0) 00000100:00100000:3.0:1787364990.490290:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+43:11602:x1874187688959104:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1270us (1574us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787364990.490299:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 202 00000100:00100000:2.0:1787364990.495767:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.495894:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688959232 00000100:00100000:0.0:1787364990.495907:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688959232 00000100:00100000:0.0:1787364990.495983:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00100000:0.0:1787364990.495996:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+6:2367:x1874187688959232:12345-192.168.204.2@tcp:1:lfs.0 00010000:00010000:0.0:1787364990.496060:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.496096:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.496106:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787364990.496111:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787364990.496117:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.496166:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 6 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.496182:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 6 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364990.496220:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c061c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6710:1874187714118528:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787364990.496351:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d401136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787364990.498883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.499523:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c061c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6710:1874187714118528:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364990.499565:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.502096:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688959360 00000100:00100000:3.0:1787364990.502142:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688959360 00002000:00100000:3.0:1787364990.502225:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b6c061c4380 x1874187688959360/t0(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:651/0 lens 504/0 e 0 to 0 dl 1787365001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787364990.502237:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6c061c4380 with x1874187688959360 ext(0->8) 00010000:00010000:3.0:1787364990.502249:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 7 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.502269:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 7 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787364990.502279:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6c061c4380 00000100:00100000:3.0:1787364990.502331:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:3.0:1787364990.502342:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688959360:12345-192.168.204.2@tcp:4:lfs.0 00000100:00100000:3.0:1787364990.503236:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+9:2366:x1874187688959360:12345-192.168.204.2@tcp:4:lfs.0 Request processed in 889us (4360us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787364990.503279:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 3 00002000:00100000:3.0:1787364990.503290:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b6c061c4380 x1874187688959360/t4294967308(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:651/0 lens 504/448 e 0 to 0 dl 1787365001 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787364990.503299:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6c061c4380 with x1874187688959360 ext(0->8) 00010000:00010000:3.0:1787364990.503735:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 9 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.503759:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 9 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787364990.503769:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6c061c4380 00000100:00100000:2.0:1787364990.508290:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364990.508428:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688959488 00000100:00100000:3.0:1787364990.508441:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688959488 00010000:00010000:3.0:1787364990.508498:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 9 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.508554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 75 00000100:00100000:3.0:1787364990.508566:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+9:2367:x1874187688959488:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364990.508588:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787364990.508612:0:5841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787364990.508615:0:5841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787364989 00002000:00010000:3.0:1787364990.508618:0:5841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787364989 00002000:00010000:3.0:1787364990.508620:0:5841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787364989 00010000:00010000:3.0:1787364990.508627:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 9 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.508643:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 9 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.508672:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000701e18ec/0xcfc9272e5fc2bc33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de52 expref: 9 pid: 12088 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.508695:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787364990.508700:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787364990.508707:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.508721:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.508771:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364990.508916:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688959488:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 351us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364990.508925:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 75 00010000:00010000:2.0:1787364990.509399:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.509411:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.509445:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.509453:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.509461:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.509468:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364990.509473:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.509482:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.509496:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.509503:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2bc72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364990.509603:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2367:x1874187688959232:12345-192.168.204.2@tcp:1:lfs.0 Request processed in 13610us (13852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364990.509613:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00100000:2.0:1787364990.517821:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364990.517954:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688959744 00000100:00100000:1.0:1787364990.517970:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688959744 00000100:00100000:1.0:1787364990.518067:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 56 00000100:00100000:1.0:1787364990.518083:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0553a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+43:11602:x1874187688959744:12345-192.168.204.2@tcp:35:lfs.0 00000004:00010000:1.0:1787364990.518204:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de67 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787364990.518559:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787364990.518608:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787364990.519054:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787364990.519116:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.519135:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.519147:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.519193:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.519210:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 47 pid: 5858 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364990.519254:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f84c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874187714118656:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364990.519368:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33c95d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787364990.525717:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364990.526044:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f84c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874187714118656:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364990.526091:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364990.526429:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688959872 00000100:00100000:2.0:1787364990.526439:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688959872 00010000:00010000:2.0:1787364990.526494:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 48 pid: 5858 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364990.526602:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 76 00000100:00100000:2.0:1787364990.526614:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+48:2367:x1874187688959872:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787364990.526639:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364990.526648:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 48 pid: 5858 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.526662:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 48 pid: 5858 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.526693:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bc1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de44 expref: 48 pid: 5858 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.526713:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:2.0:1787364990.526719:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.526730:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.526757:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.526859:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364990.526933:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+47:2367:x1874187688959872:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 320us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364990.526943:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 76 00010000:00010000:1.0:1787364990.527214:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.527224:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787364990.527400:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787364990.527685:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787364990.527867:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f84c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714118784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787364990.527949:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364990.528007:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33c95600 going to sleep for 11 seconds 00000100:00100000:0.0:1787364990.528229:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714118784 00000100:00100000:0.0:1787364990.528238:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714118784 00000100:00100000:0.0:1787364990.528317:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787364990.528328:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714118784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787364990.528440:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714118784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364990.528448:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787364990.528522:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364990.528612:0:5859:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787364990.528619:0:5859:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787364990.528649:0:5859:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d4079c000, transno 4294967307 00000100:00100000:1.0:1787364990.528671:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f84c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714118784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787364990.530277:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787364990.530396:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f84c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714118912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787364990.531452:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364990.531542:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33c95d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787364990.535005:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714118912 00000100:00100000:0.0:1787364990.535028:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714118912 00000100:00100000:0.0:1787364990.535393:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787364990.535419:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874187714118912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787364990.535883:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874187714118912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 477us (4432us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787364990.535894:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787364990.536019:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f84c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874187714118912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787364990.536134:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787364990.536210:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.536222:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.536231:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.536238:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364990.536244:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.536254:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.536274:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:1.0:1787364990.536277:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787364990.536284:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364990.536291:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bc79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787364990.536540:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787364990.536661:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787364990.536676:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436765889860ns, next at 437765886970ns, rc = 0 00000001:00080000:1.0:1787364990.536684:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787364990.536723:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9e00) 00010000:00010000:1.0:1787364990.536739:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787364990.536749:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de67 expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364990.536941:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0553a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+50:11602:x1874187688959744:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 18862us (19170us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787364990.541133:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 56 00000020:00080000:1.0:1787364990.541151:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:2.0:1787364990.541675:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364990.542921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.543027:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688960000 00000100:00100000:2.0:1787364990.543040:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688960000 00000100:00100000:2.0:1787364990.543121:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 203 00000100:00100000:2.0:1787364990.543135:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+50:11602:x1874187688960000:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364990.543170:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364990.543220:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2bc80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de6e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.543311:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2bc80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de6e expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.543329:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2bc80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de6e expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.543354:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364990.543359:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364990.543364:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449a00, rc 0) 00000100:00100000:2.0:1787364990.543460:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+51:11602:x1874187688960000:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 327us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364990.543492:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 203 00000100:00100000:2.0:1787364990.549165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364990.549477:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688960256 00000100:00100000:3.0:1787364990.549491:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688960256 00000100:00100000:3.0:1787364990.549578:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00100000:3.0:1787364990.549590:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+51:11602:x1874187688960256:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:3.0:1787364990.549945:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+52:11602:x1874187688960256:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 357us (794us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787364990.549954:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 57 00000100:00100000:1.0:1787364990.685455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364990.685832:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688960384 00000100:00100000:3.0:1787364990.685846:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688960384 00000100:00100000:3.0:1787364990.685932:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 204 00000100:00100000:3.0:1787364990.685944:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+52:11612:x1874187688960384:12345-192.168.204.2@tcp:34:lfs.0 00010000:00010000:3.0:1787364990.686063:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686086:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686101:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686121:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686149:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686157:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686291:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686301:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686309:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787364990.686361:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686377:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686384:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686392:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686406:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364990.686411:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686420:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686442:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364990.686445:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364990.686451:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686458:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bc87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686477:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686484:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686490:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686496:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364990.686499:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686505:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686512:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364990.686514:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364990.686517:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686523:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bc8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686555:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686561:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686567:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686572:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364990.686575:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686582:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686590:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:3.0:1787364990.686593:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364990.686596:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.686601:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bc95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.686719:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+52:11612:x1874187688960384:12345-192.168.204.2@tcp:34:lfs.0 Request processed in 775us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364990.686728:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 204 00000100:00100000:0.0:1787364990.734848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.735085:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688960640 00000100:00100000:2.0:1787364990.735098:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688960640 00000100:00100000:2.0:1787364990.735177:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 205 00000100:00100000:2.0:1787364990.735190:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+52:11615:x1874187688960640:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364990.735219:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364990.735249:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2bc9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de75 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.735353:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.735371:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.735384:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.735402:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.735409:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.735417:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.737489:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bcb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.737540:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.737553:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364990.737569:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787364990.738977:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.738997:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739006:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739013:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364990.739019:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739028:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739045:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364990.739049:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364990.739055:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739062:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739081:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739102:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739109:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739114:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364990.739117:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739124:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739133:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9200) 00010000:00010000:2.0:1787364990.739136:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364990.739139:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739145:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bcaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739239:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2bc9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de75 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739258:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de75 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.739266:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364990.739269:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364990.739278:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449800, rc 0) 00000100:00100000:2.0:1787364990.739387:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+54:11615:x1874187688960640:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 4199us (4599us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787364990.739398:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 205 00000100:00100000:0.0:1787364990.744841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.744892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.744935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.744975:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688960896 00000100:00100000:0.0:1787364990.744987:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688960896 00000100:00100000:0.0:1787364990.745054:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 306 00000100:00100000:0.0:1787364990.745085:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2365:x1874187688960896:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364990.745183:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2365:x1874187688960896:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364990.745192:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 306 00000100:00100000:0.0:1787364990.745256:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364990.745816:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688960768 00000100:00100000:3.0:1787364990.745822:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688960768 00000100:00100000:3.0:1787364990.745866:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688961152 00000100:00100000:3.0:1787364990.745877:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688961152 00000100:00100000:3.0:1787364990.745931:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 173 00000100:00100000:3.0:1787364990.745941:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2365:x1874187688961152:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364990.745949:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688961024 00000100:00100000:2.0:1787364990.745956:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688961024 00000100:00100000:2.0:1787364990.746009:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 103 00000100:00100000:3.0:1787364990.746014:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2365:x1874187688961152:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 73us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364990.746022:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+9:2365:x1874187688961024:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787364990.746026:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 173 00000100:00100000:2.0:1787364990.746064:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+9:2365:x1874187688961024:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 46us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364990.746073:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 103 00000100:00100000:3.0:1787364990.746132:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 206 00000100:00100000:3.0:1787364990.746140:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+54:11615:x1874187688960768:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:3.0:1787364990.746216:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.746238:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.746254:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787364990.746937:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787364990.747478:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.747493:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.747501:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.747509:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364990.747514:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.747544:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.747563:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:3.0:1787364990.747566:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787364990.747573:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.747580:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.747682:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+54:11615:x1874187688960768:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 1537us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364990.747693:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 206 00000100:00100000:3.0:1787364990.751619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364990.756504:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688961408 00000100:00100000:1.0:1787364990.756526:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688961408 00000100:00100000:1.0:1787364990.757602:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 58 00000100:00100000:1.0:1787364990.757630:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+54:11615:x1874187688961408:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:1.0:1787364990.758006:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+55:11615:x1874187688961408:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 389us (6402us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787364990.758541:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 58 00000100:00100000:0.0:1787364990.880938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.881136:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688961664 00000100:00100000:2.0:1787364990.881152:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688961664 00000100:00100000:2.0:1787364990.883365:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 207 00000100:00100000:2.0:1787364990.883400:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+55:11625:x1874187688961664:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:2.0:1787364990.883438:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364990.883442:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787364990.883558:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bc41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de59 expref: 55 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.883588:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364990.883594:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787364990.883614:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2bcc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de7c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.883870:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.883912:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.883924:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364990.883937:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787364990.885864:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2bcc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de7c expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.885897:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de7c expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.885906:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364990.885909:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364990.885913:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449200, rc 0) 00000100:00100000:2.0:1787364990.886029:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+56:11625:x1874187688961664:12345-192.168.204.2@tcp:101:bash.0 Request processed in 2647us (5108us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787364990.886040:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 207 00000100:00100000:1.0:1787364990.894077:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364990.894140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.894416:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688961792 00000100:00100000:0.0:1787364990.894430:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688961792 00000100:00100000:0.0:1787364990.894650:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:0.0:1787364990.894665:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+56:2365:x1874187688961792:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364990.894691:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364990.894742:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449200/0xcfc9272e5fc2bccd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de7c expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.894769:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787364990.894776:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364990.894922:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+55:2365:x1874187688961792:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 260us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364990.894932:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:3.0:1787364990.895778:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688962048 00000100:00100000:3.0:1787364990.895815:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688962048 00000100:00100000:3.0:1787364990.895879:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 208 00000100:00100000:3.0:1787364990.895890:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+55:11625:x1874187688962048:12345-192.168.204.2@tcp:36:bash.0 00010000:00010000:3.0:1787364990.895972:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364990.895998:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2bcb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de75 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.896018:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:3.0:1787364990.896023:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787364990.896347:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.896386:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364990.896398:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787364990.896461:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787364990.896489:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005814eacb reply state 000000006ab50ec5 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364990.896501:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787364990.896624:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+57:11625:x1874187688962048:12345-192.168.204.2@tcp:36:bash.0 Request processed in 735us (2482us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787364990.896634:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 208 00000020:00080000:3.0:1787364990.896641:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787364990.913557:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364990.913658:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688962176 00000100:00100000:0.0:1787364990.913671:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688962176 00000100:00100000:0.0:1787364990.913751:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 209 00000100:00100000:0.0:1787364990.913764:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+57:11625:x1874187688962176:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:0.0:1787364990.913851:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787364990.913879:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bce2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de83 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914012:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914028:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914037:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914059:0:5857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914072:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914370:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914380:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914388:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914394:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364990.914405:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914415:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914432:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364990.914435:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364990.914439:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914448:0:3300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914455:0:3300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914483:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364990.914489:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bcdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914545:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914553:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787364990.914589:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787364990.914593:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787364990.914615:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914648:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878e00/0xcfc9272e5fc2bce2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914661:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364990.914676:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787364990.914678:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787364990.914681:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40878800, rc 0) 00000100:00100000:0.0:1787364990.914859:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+57:11625:x1874187688962176:12345-192.168.204.2@tcp:101:bash.0 Request processed in 1097us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364990.914869:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 209 00000100:00100000:1.0:1787364990.922734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364990.922902:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688962432 00000100:00100000:2.0:1787364990.922917:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688962432 00000100:00100000:2.0:1787364990.922996:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 59 00000100:00100000:2.0:1787364990.923009:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+57:11625:x1874187688962432:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:2.0:1787364990.923367:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+58:11625:x1874187688962432:12345-192.168.204.2@tcp:35:bash.0 Request processed in 359us (649us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787364990.923376:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 59 00000100:00100000:1.0:1787364991.032388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364991.032921:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688962560 00000100:00100000:3.0:1787364991.032936:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688962560 00000100:00100000:3.0:1787364991.033044:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 210 00000100:00100000:3.0:1787364991.033067:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+58:11631:x1874187688962560:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:3.0:1787364991.033099:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364991.033127:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de8a expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.033217:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bcf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.033236:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787364991.033244:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787364991.033252:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364991.033359:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787364991.033364:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787364991.033404:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.033436:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de8a expref: 60 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.033458:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de8a expref: 59 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.033468:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364991.033472:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787364991.033476:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:3.0:1787364991.033560:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+59:11631:x1874187688962560:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 498us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.033569:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 210 00000100:00100000:0.0:1787364991.040947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364991.041174:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688962688 00000100:00100000:3.0:1787364991.041188:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688962688 00000100:00100000:3.0:1787364991.041265:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 211 00000100:00100000:3.0:1787364991.041280:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c061c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+59:11631:x1874187688962688:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:3.0:1787364991.041313:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364991.041343:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de91 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041446:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041485:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041499:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041516:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041524:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041530:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041669:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bd13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041679:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bd13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041686:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bd13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364991.041731:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787364991.041736:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787364991.041761:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bd13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041963:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bd13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041983:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041990:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.041997:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042003:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364991.042007:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042016:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042030:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:3.0:1787364991.042033:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364991.042038:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042046:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2bd05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042150:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042157:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042163:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042178:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364991.042180:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042186:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042194:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364991.042197:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787364991.042199:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042204:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2bd0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042243:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2bcfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de91 expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042255:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bd13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de91 expref: 60 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.042263:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:3.0:1787364991.042265:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787364991.042267:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030000, rc 0) 00000100:00100000:3.0:1787364991.042359:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c061c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+60:11631:x1874187688962688:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1083us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.042368:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 211 00000100:00100000:1.0:1787364991.049449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.049506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.049621:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688963072 00000100:00100000:2.0:1787364991.049664:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688963072 00000100:00100000:3.0:1787364991.049713:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688962944 00000100:00100000:3.0:1787364991.049727:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688962944 00000100:00100000:2.0:1787364991.049774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:3.0:1787364991.049819:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 212 00000100:00100000:2.0:1787364991.049824:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+61:2365:x1874187688963072:12345-192.168.204.2@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787364991.049834:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+61:11631:x1874187688962944:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364991.049848:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364991.049857:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364991.049885:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bd1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de98 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.049886:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030000/0xcfc9272e5fc2bd13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de91 expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.049921:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364991.049928:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787364991.050001:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+61:2365:x1874187688963072:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 217us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.050010:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 17 00010000:00010000:3.0:1787364991.050029:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.051024:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.051046:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.052537:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.052571:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 60 pid: 5857 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.052594:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d33f00000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714119040:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364991.052976:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98780 going to sleep for 11 seconds 00000100:00100000:1.0:1787364991.061278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.061396:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d33f00000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714119040:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364991.061432:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364991.061519:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688963200 00000100:00100000:0.0:1787364991.061538:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688963200 00010000:00010000:0.0:1787364991.061589:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 61 pid: 5857 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364991.061637:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 77 00000100:00100000:0.0:1787364991.061654:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+61:2366:x1874187688963200:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787364991.061677:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364991.061686:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 61 pid: 5857 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364991.061699:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 61 pid: 5857 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364991.061727:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40878800/0xcfc9272e5fc2bce9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de83 expref: 61 pid: 5857 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364991.061744:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787364991.061768:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364991.061831:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364991.061842:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364991.061873:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364991.061955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+60:2366:x1874187688963200:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 308us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364991.061965:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 77 00010000:00010000:1.0:1787364991.062105:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.062113:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364991.062146:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787364991.062375:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2bd1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.062397:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.062406:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787364991.062408:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787364991.062411:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c8000, rc 0) 00000100:00100000:1.0:1787364991.062455:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+60:11631:x1874187688962944:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 12625us (13025us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787364991.062463:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 212 00000100:00100000:1.0:1787364991.065308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364991.065392:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688963456 00000100:00100000:0.0:1787364991.065405:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688963456 00000100:00100000:0.0:1787364991.065482:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:0.0:1787364991.065494:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+60:11631:x1874187688963456:12345-192.168.204.2@tcp:103:lfs.0 00010000:00010000:0.0:1787364991.065515:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787364991.065557:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2bc80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de6e expref: 60 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364991.065579:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787364991.065585:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787364991.065651:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+59:11631:x1874187688963456:12345-192.168.204.2@tcp:103:lfs.0 Request processed in 153us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364991.065660:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:0.0:1787364991.067448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.067550:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688963584 00000100:00100000:2.0:1787364991.067560:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688963584 00000100:00100000:2.0:1787364991.067621:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 213 00000100:00100000:2.0:1787364991.067656:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+59:11631:x1874187688963584:12345-192.168.204.2@tcp:58:lfs.0 00010000:00010000:2.0:1787364991.067838:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.067857:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.067871:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787364991.068152:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787364991.068264:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+59:11631:x1874187688963584:12345-192.168.204.2@tcp:58:lfs.0 Request processed in 616us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.068273:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 213 00000100:00100000:3.0:1787364991.074170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.074305:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688963712 00000100:00100000:1.0:1787364991.074318:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688963712 00000100:00100000:1.0:1787364991.074406:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 214 00000100:00100000:1.0:1787364991.074420:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+59:11631:x1874187688963712:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364991.074451:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364991.074484:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67de9f expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.074568:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.074581:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de9f expref: 60 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.074631:0:8228:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.074648:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de9f expref: 60 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.074666:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787364991.074669:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787364991.074674:0:8228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de9f expref: 60 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.074682:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0c00, rc 0) 00000100:00100000:1.0:1787364991.074780:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+60:11631:x1874187688963712:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 350us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364991.074843:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 214 00010000:00010000:3.0:1787364991.563413:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787364991.627629:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787364991.627643:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787364991.627703:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787364991.627715:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787364991.628197:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffcca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714119168:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787364991.628553:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33c959c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364991.635474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.635596:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688963840 00000100:00100000:2.0:1787364991.635608:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688963840 00000100:00100000:2.0:1787364991.635697:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 215 00000100:00100000:2.0:1787364991.635708:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+61:11632:x1874187688963840:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787364991.635760:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787364991.635960:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+61:11632:x1874187688963840:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 250us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.635969:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 215 00000100:00100000:1.0:1787364991.637859:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffcca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714119168:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787364991.643943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.644546:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688963968 00000100:00100000:1.0:1787364991.644559:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688963968 00000100:00100000:1.0:1787364991.644653:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 216 00000100:00100000:1.0:1787364991.644665:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+60:11632:x1874187688963968:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787364991.645002:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645026:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645053:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645075:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645083:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645090:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645120:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645131:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645138:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364991.645193:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787364991.645198:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787364991.645215:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645229:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645244:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645252:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645259:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364991.645264:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645273:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645288:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:1.0:1787364991.645292:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364991.645297:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645305:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2bd3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645322:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645329:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645335:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645341:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364991.645350:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645359:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645368:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b6d12906200) 00010000:00010000:1.0:1787364991.645370:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364991.645373:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645380:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645529:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645537:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645542:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645547:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364991.645550:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645556:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645564:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787364991.645566:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364991.645576:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.645582:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364991.646179:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+60:11632:x1874187688963968:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 Request processed in 1511us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364991.646191:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 216 00000100:00100000:0.0:1787364991.651118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.651291:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688964224 00000100:00100000:2.0:1787364991.651303:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688964224 00000100:00100000:2.0:1787364991.651380:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 217 00000100:00100000:2.0:1787364991.651405:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+60:11632:x1874187688964224:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.651435:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364991.651462:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dea6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.651636:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.651657:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.651671:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364991.651686:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787364991.652076:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652086:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652094:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652102:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364991.652108:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652117:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652132:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364991.652135:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787364991.652141:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652160:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652217:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd52 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dea6 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652228:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:2.0:1787364991.652230:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787364991.652234:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dea6 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.652244:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448c00, rc 0) 00000100:00100000:2.0:1787364991.652331:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+61:11632:x1874187688964224:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 930us (1228us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787364991.652341:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 217 00000100:00100000:2.0:1787364991.659439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.659547:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688964352 00000100:00100000:1.0:1787364991.659559:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688964352 00000100:00100000:1.0:1787364991.659636:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 218 00000100:00100000:1.0:1787364991.659648:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+61:11632:x1874187688964352:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787364991.659698:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787364991.659891:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+61:11632:x1874187688964352:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 244us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364991.659901:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 218 00000100:00100000:1.0:1787364991.665658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.665867:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688964608 00000100:00100000:2.0:1787364991.665880:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688964608 00000100:00100000:2.0:1787364991.665951:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 219 00000100:00100000:2.0:1787364991.665964:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+61:11632:x1874187688964608:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.665990:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364991.665994:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787364991.666030:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2bcf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de8a expref: 61 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.666058:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364991.666083:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787364991.666102:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dead expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787364991.667164:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787364991.668016:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.668102:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.668119:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.668201:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dead expref: 63 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.668223:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dead expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.668233:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d104f9200) 00010000:00010000:2.0:1787364991.668237:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364991.668241:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449600, rc 0) 00000100:00100000:2.0:1787364991.668401:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+62:11632:x1874187688964608:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 2438us (2758us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787364991.668412:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 219 00000100:00100000:3.0:1787364991.683020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.683262:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688964864 00000100:00100000:1.0:1787364991.683277:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688964864 00000100:00100000:1.0:1787364991.683355:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 220 00000100:00100000:1.0:1787364991.683368:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+62:11632:x1874187688964864:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787364991.683464:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364991.683500:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449600/0xcfc9272e5fc2bd6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dead expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.683525:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d104f9200) 00010000:00010000:1.0:1787364991.683540:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787364991.683588:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.683605:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.683617:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.683635:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.683642:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.683649:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.688097:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.688123:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.688133:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.688140:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364991.688146:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.688159:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.688240:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:1.0:1787364991.688244:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364991.688252:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.688986:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bd7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.689014:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.689022:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.689029:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.689035:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:1.0:1787364991.689040:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.689047:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.689058:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x987d29f7 (ffff9b6d12906200) 00010000:00010000:1.0:1787364991.689061:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787364991.689065:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.689072:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bd83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x987d29f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364991.689522:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+61:11632:x1874187688964864:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 6147us (6508us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787364991.689534:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 220 00000100:00100000:1.0:1787364991.692352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364991.692428:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688964992 00000100:00100000:3.0:1787364991.692442:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688964992 00000100:00100000:3.0:1787364991.692522:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 221 00000100:00100000:3.0:1787364991.692535:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+61:11632:x1874187688964992:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787364991.692568:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364991.692615:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9c00/0xcfc9272e5fc2bd8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67deb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.692695:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.692713:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.692730:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.692909:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9c00/0xcfc9272e5fc2bd8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 63 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.692933:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.692944:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364991.692948:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787364991.692952:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c9600, rc 0) 00000100:00100000:3.0:1787364991.711462:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+62:11632:x1874187688964992:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 18907us (19105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.711479:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 221 00000100:00100000:0.0:1787364991.717183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.717341:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688965248 00000100:00100000:2.0:1787364991.717354:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688965248 00000100:00100000:2.0:1787364991.717436:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 222 00000100:00100000:2.0:1787364991.717448:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+62:11632:x1874187688965248:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.717576:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.717613:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.717629:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787364991.718023:0:8228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787364991.718047:0:8228:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437947249092ns, next at 438947246030ns, rc = 0 00000004:00010000:2.0:1787364991.718167:0:8228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2374a8d reply state 000000008925b5ae transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.718181:0:8228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787364991.718312:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+64:11632:x1874187688965248:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 865us (1145us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787364991.718323:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 222 00010000:00010000:3.0:1787364991.720934:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.720959:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.720969:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.720995:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787364991.721001:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.721010:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.721032:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364991.721036:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787364991.721053:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.721060:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2bd98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364991.723209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.723425:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688965376 00000100:00100000:2.0:1787364991.723438:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688965376 00000100:00100000:2.0:1787364991.723525:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 223 00000100:00100000:2.0:1787364991.723537:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4079c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+63:11632:x1874187688965376:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.723573:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364991.723610:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67debb expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.723692:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.723731:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.723907:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:2.0:1787364991.723912:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364991.723917:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448200, rc 0) 00000100:00100000:2.0:1787364991.723993:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4079c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+64:11632:x1874187688965376:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 458us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.724002:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 223 00000100:00100000:1.0:1787364991.728483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364991.728610:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688965504 00000100:00100000:0.0:1787364991.728623:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688965504 00000100:00100000:0.0:1787364991.728767:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 62 00000100:00100000:0.0:1787364991.728840:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+9:2365:x1874187688965504:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787364991.729263:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+10:2365:x1874187688965504:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 475us (793us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787364991.729273:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 62 00000100:00080000:1.0:1787364991.729340:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787364991.733363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.733475:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688965760 00000100:00100000:2.0:1787364991.733489:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688965760 00000100:00100000:2.0:1787364991.733561:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 60 00000100:00100000:2.0:1787364991.733573:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+64:11632:x1874187688965760:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787364991.734147:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+65:11632:x1874187688965760:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 574us (797us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787364991.734156:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 60 00000100:00100000:2.0:1787364991.740429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364991.740538:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688966016 00000100:00100000:3.0:1787364991.740552:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688966016 00000100:00100000:3.0:1787364991.740642:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 224 00000100:00100000:3.0:1787364991.740655:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+65:11632:x1874187688966016:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787364991.740864:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+65:11632:x1874187688966016:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 212us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.740874:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 224 00000100:00100000:3.0:1787364991.743923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.744150:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688966144 00000100:00100000:2.0:1787364991.744162:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688966144 00000100:00100000:2.0:1787364991.744238:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 225 00000100:00100000:2.0:1787364991.744251:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+65:11632:x1874187688966144:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.744282:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364991.744313:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bda6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dec2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.744457:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.744476:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.744490:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364991.744541:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364991.744564:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.744602:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2bda6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec2 expref: 67 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.744624:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec2 expref: 66 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.744633:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:2.0:1787364991.744637:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787364991.744642:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448000, rc 0) 00000100:00100000:2.0:1787364991.744735:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+66:11632:x1874187688966144:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 486us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.744744:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 225 00000100:00100000:0.0:1787364991.748892:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.749020:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688966272 00000100:00100000:2.0:1787364991.749033:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688966272 00000100:00100000:2.0:1787364991.749119:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 63 00000100:00100000:2.0:1787364991.749151:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+10:2364:x1874187688966272:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.749179:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364991.749207:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dec9 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787364991.749245:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89067e, blocks: 0x1 00010000:00010000:2.0:1787364991.749275:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787364991.749281:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364991.749295:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 11 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.749317:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 11 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.749335:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448600, rc 0) 00000100:00100000:2.0:1787364991.749406:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+11:2364:x1874187688966272:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 258us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.749414:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 63 00000100:00100000:3.0:1787364991.753640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.753756:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688966528 00000100:00100000:2.0:1787364991.753839:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688966528 00000100:00100000:2.0:1787364991.753923:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 226 00000100:00100000:2.0:1787364991.753935:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+66:11632:x1874187688966528:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787364991.754088:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+66:11632:x1874187688966528:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 156us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.754097:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 226 00000100:00100000:1.0:1787364991.757262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.757525:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688966656 00000100:00100000:2.0:1787364991.757538:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688966656 00000100:00100000:2.0:1787364991.757615:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00100000:2.0:1787364991.757627:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+11:11632:x1874187688966656:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.757652:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364991.757678:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ded0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.757721:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 12 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.757731:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364991.757736:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364991.757742:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 12 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.757831:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 12 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.757848:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 12 pid: 6710 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.757868:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6707:1874187714119296:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364991.758071:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d1866b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787364991.762118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364991.762463:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688966784 00000100:00100000:3.0:1787364991.762475:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688966784 00010000:00010000:3.0:1787364991.762532:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 13 pid: 6710 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364991.762607:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 78 00000100:00100000:3.0:1787364991.762619:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07003450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+13:2367:x1874187688966784:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364991.762640:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364991.762668:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 13 pid: 6710 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.762684:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 13 pid: 6710 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.762717:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364991.762722:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364991.762732:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 13 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.762744:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 13 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.762839:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 13 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364991.762856:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07245880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874187714119424:192.168.204.2@tcp:105: 00010000:00010000:2.0:1787364991.763340:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d98ad1/0xcfc9272e5fc2bdb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec9 expref: 13 pid: 6710 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.763375:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6707:1874187714119296:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364991.763407:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 12 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.763419:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449c00, rc 0) 00000100:00100000:3.0:1787364991.763538:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c052d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787364991.766153:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+12:11632:x1874187688966656:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 8510us (8885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.766170:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00100000:3.0:1787364991.769710:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07245880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874187714119424:192.168.204.2@tcp:105: 00010000:00010000:3.0:1787364991.769811:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364991.769894:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07003450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+11:2367:x1874187688966784:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 7275us (7791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.769909:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 78 00000100:00100000:2.0:1787364991.770176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364991.770580:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688966912 00000100:00100000:3.0:1787364991.770590:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688966912 00002000:00100000:3.0:1787364991.770646:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b6d04fd3100 x1874187688966912/t0(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:652/0 lens 504/0 e 0 to 0 dl 1787365002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787364991.770657:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d04fd3100 with x1874187688966912 ext(0->12) 00002000:00010000:3.0:1787364991.770663:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d04fd3100 00000100:00100000:3.0:1787364991.770730:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:3.0:1787364991.770741:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d04fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6b97b2b3-6991-434b-88a0-aee779536483+11:2367:x1874187688966912:12345-192.168.204.2@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787364991.771458:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d04fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6b97b2b3-6991-434b-88a0-aee779536483+13:2367:x1874187688966912:12345-192.168.204.2@tcp:4:lhsmtool_posix.0 Request processed in 713us (1277us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787364991.771471:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 6 00002000:00100000:3.0:1787364991.771480:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b6d04fd3100 x1874187688966912/t4294967320(0) o4->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:652/0 lens 504/448 e 0 to 0 dl 1787365002 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787364991.771490:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d04fd3100 with x1874187688966912 ext(0->12) 00002000:00010000:3.0:1787364991.771494:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d04fd3100 00000100:00100000:1.0:1787364991.774401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.774493:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688967040 00000100:00100000:2.0:1787364991.774506:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688967040 00000100:00100000:2.0:1787364991.774583:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 227 00000100:00100000:2.0:1787364991.774595:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+66:11632:x1874187688967040:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787364991.810948:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+66:11632:x1874187688967040:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 Request processed in 36336us (36542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364991.810965:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 227 00000001:00080000:3.0:1787364991.813084:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967484 is committed 00000004:00080000:3.0:1787364991.813104:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787364991.813142:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d099f2c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787364991.813148:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d409baf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d099f26c0 00000020:00080000:3.0:1787364991.813152:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d409bab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d40f6b400 00000001:00080000:3.0:1787364991.813204:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:3.0:1787364991.813215:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787364991.813233:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d33c95600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787364991.813237:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d10bf5d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d33c950c0 00000020:00080000:3.0:1787364991.813240:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d10bf5b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d3fa38400 00000001:00080000:3.0:1787364991.813266:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787364991.813274:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1787364991.813350:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787364991.813654:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787364991.813872:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714119552:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787364991.813968:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364991.814050:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714119552 00000100:00100000:3.0:1787364991.814061:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714119552 00000100:00100000:3.0:1787364991.814123:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787364991.814134:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1874187714119552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787364991.814171:0:12088:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1787364991.814218:0:12088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a89067d, atime: 0x6a89067d, ctime: 0x6a89067d, blocks: 0x1 00010000:00010000:3.0:1787364991.814227:0:12088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.814249:0:12088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787364991.814255:0:12088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787364991.814263:0:12088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.814284:0:12088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.814311:0:12088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.814320:0:12088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.814342:0:12088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787364991.814965:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714119552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 830us (994us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787364991.814977:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1787364991.815014:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787364991.815022:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.815034:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c9c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364991.815039:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.815052:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.815075:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.815084:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000861244c4/0xcfc9272e5fc2bdc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.815117:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364991.815120:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364991.815122:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787364991.815164:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6c07245880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787364991.815172:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714119552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787364991.815620:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787364991.815635:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714119808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787364991.815693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364991.815834:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.815861:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714119808 00000100:00100000:1.0:1787364991.815868:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714119808 00000100:00100000:1.0:1787364991.815923:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688967168 00000100:00100000:1.0:1787364991.815926:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688967168 00000100:00100000:1.0:1787364991.815946:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787364991.815955:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1874187714119808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787364991.816191:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 67 00000100:00100000:0.0:1787364991.816203:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+13:2367:x1874187688967168:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 00002000:00010000:1.0:1787364991.816390:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787364991.816395:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787364990 00002000:00010000:1.0:1787364991.816398:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787364991.816400:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787364990 -> 1787364990 00002000:00010000:1.0:1787364991.816403:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787364991.816461:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714119808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 506us (767us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787364991.816484:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787364991.816509:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787364991.816721:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d40147b80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787364991.816729:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714119808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787364991.817182:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714119680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787364991.817237:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364991.817280:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714119680 00000100:00100000:3.0:1787364991.817287:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714119680 00000100:00100000:3.0:1787364991.817325:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787364991.817333:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1874187714119680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787364991.817359:0:6710:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1787364991.817387:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.817413:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 13 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.817423:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787364991.817428:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787364991.817434:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.817657:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 13 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.817697:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 13 pid: 6710 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364991.817712:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c07245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6710:1874187714119936:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787364991.817841:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787364991.823845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.823899:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688967296 00000100:00100000:1.0:1787364991.823911:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688967296 00010000:00010000:1.0:1787364991.823968:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 14 pid: 6710 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364991.824016:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 79 00000100:00100000:1.0:1787364991.824028:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+14:2366:x1874187688967296:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364991.824130:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364991.824139:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 14 pid: 6710 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.824156:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 14 pid: 6710 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.824194:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364991.824200:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364991.824207:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.824221:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.824247:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364991.824331:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+14:2366:x1874187688967296:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 305us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364991.824341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 79 00010000:00010000:2.0:1787364991.824723:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2bb84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de2f expref: 13 pid: 6710 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.824743:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c07245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6710:1874187714119936:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364991.824820:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.824833:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.824854:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.824866:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.824874:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.824896:0:6710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787364991.825824:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1874187714119680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8484us (8580us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787364991.825836:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1787364991.827435:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787364991.827453:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.827472:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c8a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787364991.827478:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.827491:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.827519:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.827528:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062fb272b/0xcfc9272e5fc2bdc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.827557:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364991.827559:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787364991.827561:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787364991.828623:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d40145880/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787364991.828639:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714119680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787364991.889458:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+12:2367:x1874187688967168:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 Request processed in 73240us (73608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.889477:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 67 00000001:00080000:3.0:1787364991.889532:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1787364991.889545:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1787364991.889562:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1787364991.893368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.893497:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688967552 00000100:00100000:2.0:1787364991.893511:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688967552 00000100:00100000:2.0:1787364991.893589:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 228 00000100:00100000:2.0:1787364991.893602:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+20:11632:x1874187688967552:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.893676:0:8228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787364991.893718:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dec2 expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.893744:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:2.0:1787364991.893751:0:8228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787364991.894011:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.894052:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.894064:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787364991.894409:0:8228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edc9cd72 reply state 00000000841ddb8f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.894421:0:8228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787364991.894620:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+21:11632:x1874187688967552:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 1018us (1266us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787364991.894629:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 228 00010000:00010000:2.0:1787364991.897002:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.897026:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.897035:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.897043:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364991.897048:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.897058:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.897081:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:2.0:1787364991.897106:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364991.897114:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.897121:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2bdd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364991.898447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.898556:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688967680 00000100:00100000:2.0:1787364991.898569:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688967680 00000100:00100000:2.0:1787364991.898643:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:2.0:1787364991.898655:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2366:x1874187688967680:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787364991.899056:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787364991.899061:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787364990 -> 1787364990 00002000:00010000:2.0:1787364991.899064:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787364989 00002000:00010000:2.0:1787364991.899067:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787364990 -> 1787364990 00002000:00010000:2.0:1787364991.899069:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787364991.899147:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688967680:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 493us (714us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787364991.899157:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:0.0:1787364991.907942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.908035:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688967936 00000100:00100000:2.0:1787364991.908049:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688967936 00000100:00100000:2.0:1787364991.908124:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 229 00000100:00100000:2.0:1787364991.908136:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+20:11632:x1874187688967936:12345-192.168.204.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787364991.908234:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.908256:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.908292:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.908340:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.908357:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 20 pid: 5858 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.908376:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714120064:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364991.908505:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063f9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787364991.911345:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874187714120064:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364991.911399:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364991.911591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364991.913255:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688968064 00000100:00100000:3.0:1787364991.913278:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688968064 00010000:00010000:3.0:1787364991.913345:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 21 pid: 5858 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364991.913408:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 80 00000100:00100000:3.0:1787364991.913419:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+21:2367:x1874187688968064:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364991.913440:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364991.913449:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 21 pid: 5858 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.913487:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 21 pid: 5858 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.913520:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2bd91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deb4 expref: 21 pid: 5858 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.913542:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364991.913548:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.913559:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.913568:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.913609:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787364991.913649:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.913657:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364991.913691:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+20:2367:x1874187688968064:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 273us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.913700:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 80 00010000:00010000:2.0:1787364991.914010:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.914021:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.914028:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.914044:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364991.914050:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.914059:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.914070:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:2.0:1787364991.914073:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787364991.914078:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.914085:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.914152:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+19:11632:x1874187688967936:12345-192.168.204.2@tcp:55:lhsmtool_posix.0 Request processed in 6017us (6225us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787364991.914160:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 229 00000100:00100000:0.0:1787364991.919912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.920014:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688968192 00000100:00100000:1.0:1787364991.920028:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688968192 00000100:00100000:1.0:1787364991.920102:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 70 00000100:00100000:1.0:1787364991.920133:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688968192:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787364991.920201:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.920226:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.920237:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787364991.920242:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364991.920248:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.920293:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.920313:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 8 pid: 6707 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364991.920331:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6709:1874187714120192:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364991.920454:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d123ef000 going to sleep for 11 seconds 00000100:00100000:1.0:1787364991.925865:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6709:1874187714120192:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364991.925909:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364991.932523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.932851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688968320 00000100:00100000:1.0:1787364991.932882:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688968320 00010000:00010000:1.0:1787364991.932940:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 9 pid: 6707 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364991.932988:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 81 00000100:00100000:1.0:1787364991.933000:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+9:2366:x1874187688968320:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364991.933023:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364991.933067:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 9 pid: 6707 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.933084:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 9 pid: 6707 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.933116:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050b62499/0xcfc9272e5fc2bdbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded0 expref: 9 pid: 6707 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.933139:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364991.933144:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787364991.933152:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.933165:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.933213:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364991.933286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688968320:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 287us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364991.933306:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 81 00010000:00010000:2.0:1787364991.934652:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.934687:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.934739:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.934749:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.934820:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.934829:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787364991.934835:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.934846:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.934868:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.934876:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f91ea48/0xcfc9272e5fc2bdde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.934994:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2367:x1874187688968192:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 Request processed in 14858us (15091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.935005:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 70 00000100:00100000:0.0:1787364991.940144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.940298:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688968576 00000100:00100000:1.0:1787364991.940311:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688968576 00000100:00100000:1.0:1787364991.940386:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 230 00000100:00100000:1.0:1787364991.940397:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+19:11632:x1874187688968576:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787364991.940509:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.940532:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.940548:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.940938:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.940954:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.940965:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.941014:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.941042:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 20 pid: 5857 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364991.941075:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d07d47480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714120320:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787364991.941290:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d123ef000 going to sleep for 11 seconds 00000100:00100000:1.0:1787364991.946407:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d07d47480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714120320:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787364991.946453:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364991.947122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364991.947261:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688968704 00000100:00100000:3.0:1787364991.947271:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688968704 00010000:00010000:3.0:1787364991.947325:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 21 pid: 5857 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787364991.947375:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 82 00000100:00100000:3.0:1787364991.947386:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+21:2366:x1874187688968704:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787364991.947430:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787364991.947438:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 21 pid: 5857 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.947453:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 21 pid: 5857 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.947482:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448200/0xcfc9272e5fc2bd9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67debb expref: 21 pid: 5857 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.947502:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:3.0:1787364991.947508:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.947520:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.947529:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.947570:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787364991.947639:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b97b2b3-6991-434b-88a0-aee779536483+20:2366:x1874187688968704:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 254us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.947649:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 82 00010000:00010000:2.0:1787364991.947826:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.947836:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787364991.948133:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787364991.948389:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787364991.948468:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787364991.948628:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874187714120448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787364991.948717:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364991.948761:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0133a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787364991.948813:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714120448 00000100:00100000:3.0:1787364991.948821:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714120448 00000100:00100000:3.0:1787364991.948921:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787364991.948932:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d33c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1874187714120448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787364991.949031:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d33c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1874187714120448:12345-0@lo:1000:mdt00_000.0 Request processed in 101us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364991.949047:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787364991.949221:0:5856:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787364991.949228:0:5856:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787364991.949252:0:5856:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d40147b80, transno 4294967321 00000100:00100000:2.0:1787364991.949333:0:5856:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b6d40145880 x1874187714119680/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787365007 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787364991.949347:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874187714120448:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787364991.950819:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787364991.950952:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874187714120576:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787364991.951101:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364991.951148:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98780 going to sleep for 11 seconds 00000100:00100000:0.0:1787364991.951182:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714120576 00000100:00100000:0.0:1787364991.951192:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714120576 00000100:00100000:0.0:1787364991.951270:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787364991.951295:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1874187714120576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787364991.951563:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5856:x1874187714120576:12345-0@lo:1000:mdt00_000.0 Request processed in 270us (528us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787364991.951572:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787364991.951919:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d04fd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874187714120576:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787364991.951967:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.951978:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.951986:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.951993:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364991.951999:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952017:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952420:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d10b29e00) 00010000:00010000:2.0:1787364991.952427:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364991.952438:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952448:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2bdec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952518:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952527:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952538:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952547:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364991.952553:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952651:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.952669:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364991.952674:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787364991.953134:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de9f expref: 23 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.953187:0:5856:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de9f expref: 23 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.953203:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de9f expref: 23 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.953954:0:5856:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de9f expref: 23 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364991.953987:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714120704:192.168.204.2@tcp:105: 00000100:00100000:2.0:1787364991.955169:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d063f9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787364991.957196:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874187714120704:192.168.204.2@tcp:105: 00010000:00010000:2.0:1787364991.957238:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957260:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2bd2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957307:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957326:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957341:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957353:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957381:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957388:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957396:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448000 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364991.957401:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957409:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957425:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364991.957429:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364991.957433:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957439:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2bdf3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957450:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957456:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957462:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957468:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364991.957477:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957484:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957493:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364991.957496:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787364991.957499:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364991.957505:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2bde5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364991.957674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364991.957879:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+23:11632:x1874187688968576:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 17483us (17749us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787364991.957892:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 230 00000020:00080000:2.0:1787364991.957900:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787364991.958007:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787364991.958013:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787364991.958545:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787364991.958555:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787364991.959208:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688968832 00000100:00100000:1.0:1787364991.959220:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688968832 00000100:00100000:1.0:1787364991.959286:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00100000:1.0:1787364991.959297:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+23:11631:x1874187688968832:12345-192.168.204.2@tcp:49:lfs.0 00000100:00100000:1.0:1787364991.959460:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+23:11631:x1874187688968832:12345-192.168.204.2@tcp:49:lfs.0 Request processed in 164us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364991.959469:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 61 00000100:00100000:0.0:1787364991.963844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364991.963919:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364991.963977:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688969344 00000100:00100000:1.0:1787364991.963990:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688969344 00000100:00100000:2.0:1787364991.964060:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688969088 00000100:00100000:2.0:1787364991.964064:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688969088 00000100:00100000:1.0:1787364991.964138:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 62 00000100:00100000:1.0:1787364991.964152:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d05539c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+24:11632:x1874187688969344:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787364991.965357:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787364991.965494:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787364991.965557:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.965579:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.965595:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.965612:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.965621:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.965628:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364991.965655:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787364991.965801:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787364991.965811:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.965819:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0400 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787364991.965823:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.965833:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.965849:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d12906200) 00010000:00010000:3.0:1787364991.965853:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787364991.965858:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.965865:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2bdfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364991.965886:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364991.965888:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364991.965890:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787364991.966705:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d05539c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+26:11632:x1874187688969344:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 2545us (2776us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787364991.966719:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 62 00000020:00080000:1.0:1787364991.966727:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787364991.967138:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 231 00000100:00100000:2.0:1787364991.967159:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+25:11631:x1874187688969088:12345-192.168.204.2@tcp:58:lfs.0 00000040:00080000:2.0:1787364991.967467:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787364991.967534:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+25:11631:x1874187688969088:12345-192.168.204.2@tcp:58:lfs.0 Request processed in 385us (3747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364991.967543:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 231 00000100:00100000:0.0:1787364992.000928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364992.001316:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688969472 00000100:00100000:2.0:1787364992.001330:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688969472 00000100:00100000:2.0:1787364992.001419:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 232 00000100:00100000:2.0:1787364992.001434:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+25:11634:x1874187688969472:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787364992.001491:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364992.001522:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2be01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67ded7 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.001612:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.001630:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.001644:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.001663:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.001671:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.001692:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.002147:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.002162:0:8228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.002173:0:8228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.002215:0:8228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.002240:0:8228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 26 pid: 5856 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787364992.002260:0:8228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714120832:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787364992.002380:0:8228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98780 going to sleep for 11 seconds 00000100:00100000:3.0:1787364992.007209:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364992.007900:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688969728 00000100:00100000:0.0:1787364992.007915:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688969728 00000100:00100000:0.0:1787364992.008002:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 63 00000100:00100000:0.0:1787364992.008016:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+27:5605:x1874187688969728:12345-192.168.204.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787364992.008360:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+28:5605:x1874187688969728:12345-192.168.204.2@tcp:35:ldlm_bl.0 Request processed in 347us (1167us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787364992.008369:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 63 00000100:00100000:2.0:1787364992.013003:0:8228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8228:1874187714120832:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787364992.013471:0:8228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364992.013567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364992.017950:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688969856 00000100:00100000:1.0:1787364992.017971:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688969856 00010000:00010000:1.0:1787364992.018182:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 28 pid: 5856 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787364992.018242:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 83 00000100:00100000:1.0:1787364992.018255:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+28:2367:x1874187688969856:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364992.018276:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364992.018285:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 28 pid: 5856 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364992.018301:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 28 pid: 5856 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364992.018357:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c8000/0xcfc9272e5fc2bd21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de98 expref: 28 pid: 5856 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364992.018382:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787364992.018390:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364992.018402:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364992.018412:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364992.018455:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364992.018610:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b97b2b3-6991-434b-88a0-aee779536483+27:2367:x1874187688969856:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 357us (5048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364992.018620:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 83 00010000:00010000:2.0:1787364992.019150:0:8228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019162:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787364992.019224:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787364992.019230:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787364992.019255:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019272:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019284:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019292:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019317:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019324:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364992.019329:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019338:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019352:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:2.0:1787364992.019356:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364992.019360:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019367:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2be08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019381:0:8228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019388:0:8228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019395:0:8228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019401:0:8228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787364992.019404:0:8228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019420:0:8228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019429:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d104f9100) 00010000:00010000:2.0:1787364992.019432:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787364992.019435:0:8228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019442:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448600/0xcfc9272e5fc2be0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019489:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448000/0xcfc9272e5fc2be01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded7 expref: 27 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019505:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded7 expref: 26 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364992.019514:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787364992.019516:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787364992.019518:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448c00, rc 0) 00000100:00100000:2.0:1787364992.019567:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+26:11634:x1874187688969472:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 18137us (18657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364992.019576:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 232 00010000:00010000:1.0:1787364992.591586:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787364992.980582:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787364992.980591:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787364992.980642:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787364992.980649:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787364992.980827:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3fd4d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714120960:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787364992.980932:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787364992.998475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364992.998511:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688969984 00000100:00100000:2.0:1787364992.998519:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688969984 00000100:00100000:2.0:1787364992.998569:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 233 00000100:00100000:2.0:1787364992.998580:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+27:11645:x1874187688969984:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000100:00100000:1.0:1787364992.998601:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3fd4d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1874187714120960:192.168.204.2@tcp:107:hsm_cdtr.0 00000004:00000080:2.0:1787364992.998616:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787364992.998735:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+26:11645:x1874187688969984:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 157us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364992.998742:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 233 00000100:00100000:1.0:1787364993.005896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364993.005949:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688970240 00000100:00100000:1.0:1787364993.005957:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688970240 00000100:00100000:1.0:1787364993.006016:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 234 00000100:00100000:1.0:1787364993.006027:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+26:11645:x1874187688970240:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787364993.006047:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364993.006068:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2be1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dede expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.006320:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2be24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.006337:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2be24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.006351:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2be24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364993.006364:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787364993.006522:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1200/0xcfc9272e5fc2be1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dede expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.006540:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2be24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dede expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.006548:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787364993.006552:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787364993.006555:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1c00, rc 0) 00000100:00100000:1.0:1787364993.006624:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b97b2b3-6991-434b-88a0-aee779536483+28:11645:x1874187688970240:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 598us (737us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787364993.006631:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 234 00000100:00080000:1.0:1787364993.006661:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364993.013298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364993.013338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364993.013369:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688970624 00000100:00100000:1.0:1787364993.013378:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688970624 00000100:00100000:1.0:1787364993.013435:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:1.0:1787364993.013454:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+28:2366:x1874187688970624:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787364993.013472:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787364993.013498:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2be24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dede expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.013516:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787364993.013520:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787364993.013569:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b97b2b3-6991-434b-88a0-aee779536483+27:2366:x1874187688970624:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 118us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364993.013577:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:0.0:1787364993.013964:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688970496 00000100:00100000:0.0:1787364993.013970:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688970496 00000100:00100000:0.0:1787364993.014008:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 235 00000100:00100000:0.0:1787364993.014016:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+27:11645:x1874187688970496:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787364993.014106:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014121:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014265:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014473:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014481:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014489:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014495:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364993.014500:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014508:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014519:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787364993.014523:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787364993.014527:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.014533:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879200/0xcfc9272e5fc2be32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787364993.014629:0:12583:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787364993.014635:0:12583:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787364993.014681:0:12583:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787364993.014688:0:12583:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787364993.014688:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+28:11645:x1874187688970496:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 672us (1397us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787364993.014702:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 235 00000040:00080000:1.0:1787364993.014874:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787364993.014878:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787364993.015544:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787364993.015554:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787364993.021637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364993.021739:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688970880 00000100:00100000:2.0:1787364993.021758:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688970880 00000100:00100000:2.0:1787364993.021837:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00100000:2.0:1787364993.021847:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+28:11645:x1874187688970880:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787364993.022077:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+29:11645:x1874187688970880:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 232us (449us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787364993.022085:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 64 00000100:00100000:1.0:1787364993.042866:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714121088:0@lo:400:kworker.0 00000100:00100000:0.0:1787364993.042896:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714121344:0@lo:400:kworker.0 00000100:00100000:2.0:1787364993.048938:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714121472:0@lo:400:kworker.0 00000100:00100000:3.0:1787364993.051101:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714121216:0@lo:400:kworker.0 00000100:00100000:0.0:1787364993.053712:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364993.053810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787364993.053836:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714121088 00000100:00100000:0.0:1787364993.053846:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714121088 00000100:00100000:1.0:1787364993.053858:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714121600:0@lo:400:kworker.0 00000100:00100000:0.0:1787364993.053896:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787364993.053907:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714121088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364993.053913:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364993.053954:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714121344 00000100:00100000:1.0:1787364993.053959:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714121344 00000100:00100000:0.0:1787364993.053969:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714121088:12345-0@lo:400:kworker.0 Request processed in 64us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364993.053976:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787364993.054004:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714121600 00000100:00100000:1.0:1787364993.054008:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714121600 00000100:00100000:1.0:1787364993.054038:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787364993.054045:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714121344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364993.054089:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714121344:12345-0@lo:400:kworker.0 Request processed in 45us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364993.054103:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787364993.054118:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787364993.054124:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714121600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787364993.054155:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714121600:12345-0@lo:400:kworker.0 Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364993.054162:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1787364993.054184:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364993.054213:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714121088:0@lo:400:kworker.0 00000100:00100000:2.0:1787364993.054658:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364993.054704:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714121472 00000100:00100000:2.0:1787364993.054709:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714121472 00000100:00100000:3.0:1787364993.057647:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364993.057654:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787364993.057676:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fd4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714121472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364993.057700:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714121728:0@lo:400:kworker.0 00000100:00100000:3.0:1787364993.057736:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787364993.057763:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fd4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874187714121472:12345-0@lo:400:kworker.0 Request processed in 93us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364993.057771:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787364993.064167:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714121600:0@lo:400:kworker.0 00000100:00080000:1.0:1787364993.064223:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787364993.064267:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714121344:0@lo:400:kworker.0 00000100:00100000:0.0:1787364993.069288:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714121216 00000100:00100000:0.0:1787364993.069304:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714121216 00000100:00100000:0.0:1787364993.069423:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787364993.069433:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714121216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787364993.069527:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714121216:12345-0@lo:400:kworker.0 Request processed in 96us (11886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364993.069534:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787364993.072585:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714121216:0@lo:400:kworker.0 00000100:00100000:2.0:1787364993.072670:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714121728 00000100:00100000:2.0:1787364993.072677:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714121728 00000100:00080000:3.0:1787364993.073135:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787364993.076760:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787364993.076781:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714121728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787364993.076965:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714121728:12345-0@lo:400:kworker.0 Request processed in 191us (19225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364993.076974:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787364993.077034:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714121472:0@lo:400:kworker.0 00000100:00100000:2.0:1787364993.080512:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714121728:0@lo:400:kworker.0 00000100:00100000:0.0:1787364993.299381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364993.300946:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688971136 00000100:00100000:1.0:1787364993.300961:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688971136 00000100:00100000:1.0:1787364993.301043:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 236 00000100:00100000:1.0:1787364993.301054:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+29:11658:x1874187688971136:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787364993.301078:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787364993.301100:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2be39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dee5 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.301206:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2be40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.301222:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2be40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.301234:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2be40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787364993.301261:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787364993.301388:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2be39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dee5 expref: 32 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.301411:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2be40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dee5 expref: 31 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787364993.301419:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787364993.301422:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787364993.301426:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0400, rc 0) 00000100:00100000:1.0:1787364993.301483:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+31:11658:x1874187688971136:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 431us (2114us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787364993.301489:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 236 00000100:00100000:1.0:1787364993.306936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364993.307022:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688971264 00000100:00100000:0.0:1787364993.307032:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688971264 00000100:00100000:0.0:1787364993.307093:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 237 00000100:00100000:0.0:1787364993.307104:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+31:11658:x1874187688971264:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:0.0:1787364993.307174:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307192:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307204:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307231:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307251:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307258:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307264:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787364993.307269:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307277:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307289:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787364993.307292:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787364993.307297:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787364993.307302:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879600/0xcfc9272e5fc2be4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787364993.307374:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+31:11658:x1874187688971264:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 272us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364993.307381:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 237 00000100:00100000:0.0:1787364993.448051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364993.448151:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688971392 00000100:00100000:2.0:1787364993.448160:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688971392 00000100:00100000:2.0:1787364993.448242:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 71 00000100:00100000:2.0:1787364993.448252:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+7:2364:x1874187688971392:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:2.0:1787364993.448271:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787364993.448296:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000701e18ec/0xcfc9272e5fc2be55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67deec expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787364993.448325:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a89067e, atime: 0x6a89067d, ctime: 0x6a89067e, blocks: 0xb 00010000:00010000:2.0:1787364993.448345:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1787364993.448349:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787364993.448358:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000701e18ec/0xcfc9272e5fc2be55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deec expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364993.448386:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000701e18ec/0xcfc9272e5fc2be55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deec expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787364993.448398:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449e00, rc 0) 00000100:00100000:2.0:1787364993.448463:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+8:2364:x1874187688971392:12345-192.168.204.2@tcp:101:cat.0 Request processed in 212us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364993.448470:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 71 00000100:00080000:3.0:1787364993.449963:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787364993.453200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787364993.453370:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688971520 00000100:00100000:1.0:1787364993.453381:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688971520 00002000:00100000:1.0:1787364993.453443:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b6c07245c00 x1874187688971520/t0(0) o3->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:654/0 lens 488/0 e 0 to 0 dl 1787365004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364993.453453:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6c07245c00 with x1874187688971520 ext(0->4095) 00002000:00010000:1.0:1787364993.453458:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6c07245c00 00000100:00100000:1.0:1787364993.453498:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787364993.453508:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c07245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688971520:12345-192.168.204.2@tcp:3:cat.0 00000100:00100000:1.0:1787364993.453704:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c07245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6b97b2b3-6991-434b-88a0-aee779536483+8:2366:x1874187688971520:12345-192.168.204.2@tcp:3:cat.0 Request processed in 197us (512us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787364993.453713:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00002000:00100000:1.0:1787364993.453751:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b6c07245c00 x1874187688971520/t0(0) o3->6b97b2b3-6991-434b-88a0-aee779536483@192.168.204.2@tcp:654/0 lens 488/4536 e 0 to 0 dl 1787365004 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787364993.453760:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6c07245c00 with x1874187688971520 ext(0->4095) 00002000:00010000:1.0:1787364993.453764:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6c07245c00 00000100:00100000:1.0:1787364993.547072:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787364993.547133:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787364993.547156:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714121856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364993.547227:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364993.547245:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714121984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364993.547281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364993.547325:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714121856 00000100:00100000:1.0:1787364993.547332:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714121856 00000100:00100000:1.0:1787364993.547387:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714121984 00000100:00100000:1.0:1787364993.547391:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714121984 00000100:00100000:1.0:1787364993.550392:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787364993.550417:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714121856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364993.550466:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787364993.551428:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787364993.551446:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714121984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787364993.551476:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364993.553573:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714121856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3089us (6266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364993.553587:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787364993.553945:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714121856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787364993.554798:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714121984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3341us (7498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364993.554810:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787364993.554867:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714121984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787364993.614235:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787364994.126279:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1787364994.126645:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787364994.126656:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1787364994.635648:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787364995.661293:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364995.865639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364995.865702:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364995.865754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364995.865783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364995.865840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787364995.865873:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688972160 00000100:00100000:0.0:1787364995.865884:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688972160 00000100:00100000:0.0:1787364995.865957:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688971776 00000100:00100000:0.0:1787364995.865961:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688971776 00000100:00100000:0.0:1787364995.865984:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 177 00000100:00100000:0.0:1787364995.865993:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688972160:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364995.866085:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2367:x1874187688972160:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364995.866095:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 177 00000100:00100000:0.0:1787364995.866113:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 178 00000100:00100000:0.0:1787364995.866120:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+31:2367:x1874187688971776:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787364995.866150:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+31:2367:x1874187688971776:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 31us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787364995.866156:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 178 00000100:00080000:0.0:1787364995.866174:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787364995.866699:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688971904 00000100:00100000:1.0:1787364995.866705:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688971904 00000100:00100000:1.0:1787364995.866748:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688972032 00000100:00100000:1.0:1787364995.866752:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688972032 00000100:00100000:1.0:1787364995.866772:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 106 00000100:00100000:1.0:1787364995.866780:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688971904:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364995.866856:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688971904:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 78us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364995.866876:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 106 00000100:00100000:1.0:1787364995.866890:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 107 00000100:00100000:1.0:1787364995.866896:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688972032:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787364995.866935:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b97b2b3-6991-434b-88a0-aee779536483+8:2367:x1874187688972032:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 28us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364995.866941:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 107 00000100:00100000:2.0:1787364995.867081:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688971648 00000100:00100000:2.0:1787364995.867086:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688971648 00000100:00100000:2.0:1787364995.867121:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 308 00000100:00100000:2.0:1787364995.867129:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688971648:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787364995.867157:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688971648:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 30us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787364995.867163:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 308 00000100:00080000:0.0:1787364995.868266:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787364995.868272:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787364996.684499:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787364997.224265:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1787364997.224284:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1787364997.260116:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1787364997.260349:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787364997.261071:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d187d2900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787364997.261078:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d408bb700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6c05f866c0 00000020:00080000:3.0:1787364997.261082:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6d408bbc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d062c8400 00000020:00080000:0.0:1787364997.261164:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:0.0:1787364997.261366:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787364997.262134:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1787364997.706948:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787364998.164583:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c061c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714122496:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.164682:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364998.164736:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787364998.164742:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714122112:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.164781:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364998.164829:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714122624:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.164855:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364998.164881:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714122240:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.164905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364998.164923:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d3f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714122752:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.164958:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364998.164980:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787364998.164986:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c061c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714122368:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165008:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787364998.165041:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714122496 00000100:00100000:3.0:1787364998.165048:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714122496 00000100:00100000:3.0:1787364998.165096:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714122752 00000100:00100000:3.0:1787364998.165099:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714122752 00000100:00100000:3.0:1787364998.165120:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787364998.165128:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165179:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714122496:12345-0@lo:400:kworker.0 Request processed in 52us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364998.165187:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787364998.165204:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787364998.165210:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714122752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165241:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714122752:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364998.165247:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787364998.165264:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714122112 00000100:00100000:3.0:1787364998.165268:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714122112 00000100:00100000:3.0:1787364998.165300:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787364998.165306:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714122112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165338:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3313:x1874187714122112:12345-0@lo:400:kworker.0 Request processed in 32us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364998.165344:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787364998.165370:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714122624 00000100:00100000:3.0:1787364998.165374:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714122624 00000100:00100000:3.0:1787364998.165399:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714122240 00000100:00100000:3.0:1787364998.165402:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714122240 00000100:00100000:3.0:1787364998.165413:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714122368 00000100:00100000:3.0:1787364998.165416:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714122368 00000100:00100000:3.0:1787364998.165429:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787364998.165436:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714122624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165466:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714122624:12345-0@lo:400:kworker.0 Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364998.165472:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787364998.165484:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787364998.165489:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3c7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714122240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165513:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3c7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714122240:12345-0@lo:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364998.165519:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787364998.165531:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787364998.165537:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714122368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165564:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714122368:12345-0@lo:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364998.165569:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1787364998.165594:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787364998.165605:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787364998.165607:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787364998.165640:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c061c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714122368:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165665:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714122240:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.165672:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787364998.165677:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d40145880, transno 4294967322 00000004:00080000:3.0:1787364998.165689:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787364998.165710:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714122752:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.166071:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714122112:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.166083:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d3f84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714122624:0@lo:400:kworker.0 00000100:00100000:3.0:1787364998.166092:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787364998.166095:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787364998.166106:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6c07245880, transno 4294967310 00000100:00100000:3.0:1787364998.166116:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c061c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714122496:0@lo:400:kworker.0 00000100:00100000:0.0:1787364998.633588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364998.633725:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688972288 00000100:00100000:3.0:1787364998.635217:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688972288 00000100:00080000:0.0:1787364998.635290:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787364998.635312:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 238 00000100:00100000:3.0:1787364998.635322:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+18:11312:x1874187688972288:12345-192.168.204.2@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787364998.635610:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b97b2b3-6991-434b-88a0-aee779536483+18:11312:x1874187688972288:12345-192.168.204.2@tcp:60:lhsmtool_posix.0 Request processed in 287us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364998.635619:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 238 00000100:00100000:0.0:1787364998.647371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787364998.648039:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688972544 00000100:00100000:2.0:1787364998.648056:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688972544 00000100:00100000:2.0:1787364998.648159:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 65 00000100:00100000:2.0:1787364998.648173:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+18:11312:x1874187688972544:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787364998.649562:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+19:11312:x1874187688972544:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 1379us (2197us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787364998.649574:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 65 00000100:00100000:1.0:1787364998.668412:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787364998.668445:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714123008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787364998.668548:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364998.668669:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714123008 00000100:00100000:1.0:1787364998.668679:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714123008 00000100:00100000:1.0:1787364998.668739:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787364998.668749:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714123008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787364998.668818:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364998.668875:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714123008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364998.668882:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787364998.668937:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714123008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787364998.670353:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787364998.670387:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714122880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787364998.670473:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787364998.671438:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714122880 00000100:00100000:1.0:1787364998.671452:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714122880 00000100:00100000:1.0:1787364998.672008:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787364998.672022:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714122880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787364998.672078:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787364998.672456:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714122880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 436us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787364998.672465:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787364998.672814:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714122880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787364998.731029:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787364998.966616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787364998.966760:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688972672 00000100:00100000:3.0:1787364998.966774:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688972672 00000100:00100000:3.0:1787364998.966949:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 239 00000100:00100000:3.0:1787364998.966961:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:12109:x1874187688972672:12345-192.168.204.2@tcp:101:lsof.0 00010000:00010000:3.0:1787364998.966992:0:8228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787364998.967028:0:8228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9c00/0xcfc9272e5fc2be5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67def3 expref: -99 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364998.967129:0:8228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2be63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364998.967149:0:8228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2be63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364998.967165:0:8228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2be63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787364998.967521:0:8228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787364998.967526:0:8228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787364998.967626:0:8228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2be63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364998.967673:0:8228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9c00/0xcfc9272e5fc2be5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67def3 expref: 7 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364998.967695:0:8228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2be63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67def3 expref: 6 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787364998.967703:0:8228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:3.0:1787364998.967707:0:8228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787364998.967711:0:8228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c9600, rc 0) 00000100:00100000:3.0:1787364998.968017:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:12109:x1874187688972672:12345-192.168.204.2@tcp:101:lsof.0 Request processed in 1057us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787364998.968027:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 239 00000100:00080000:0.0:1787364998.973180:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787364999.755414:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365000.779012:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365000.988713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365000.988767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365000.990315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365000.990360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365000.990446:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688972800 00000100:00100000:2.0:1787365000.990460:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688972800 00000100:00100000:2.0:1787365000.990547:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 310 00000100:00100000:2.0:1787365000.990559:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688972800:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787365000.990677:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf99abb4-88a3-48fa-9491-b4225d983398+13:2367:x1874187688972800:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 120us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365000.990685:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 310 00000100:00100000:1.0:1787365000.992852:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688972928 00000100:00100000:1.0:1787365000.992874:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688972928 00000100:00100000:1.0:1787365000.992979:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 182 00000100:00100000:1.0:1787365000.992996:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+19:2367:x1874187688972928:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365000.993122:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b97b2b3-6991-434b-88a0-aee779536483+19:2367:x1874187688972928:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 132us (4425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365000.993131:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 182 00000100:00080000:2.0:1787365000.993694:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365000.999051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365001.000712:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688973312 00000100:00100000:2.0:1787365001.000733:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688973312 00000100:00100000:2.0:1787365001.000895:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 183 00000100:00100000:2.0:1787365001.000912:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2367:x1874187688973312:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787365001.001037:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2367:x1874187688973312:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 131us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365001.001047:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 183 00000100:00080000:0.0:1787365001.002421:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365001.012923:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688973184 00000100:00100000:3.0:1787365001.012964:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688973184 00000100:00100000:2.0:1787365001.013480:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688973056 00000100:00100000:2.0:1787365001.013487:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688973056 00000100:00080000:0.0:1787365001.013678:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787365001.013684:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365001.013751:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 110 00000100:00100000:2.0:1787365001.013765:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:2367:x1874187688973184:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787365001.013917:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+7:2367:x1874187688973184:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 155us (25147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365001.013926:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 110 00000100:00100000:2.0:1787365001.013949:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 111 00000100:00100000:2.0:1787365001.013970:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688973056:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787365001.014002:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b97b2b3-6991-434b-88a0-aee779536483+5:2367:x1874187688973056:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 34us (23641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365001.014009:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 111 00000040:00080000:2.0:1787365001.227492:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787365001.227524:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787365001.227957:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1787365001.227966:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787365001.803380:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787365002.345927:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787365002.345979:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787365002.346002:0:5889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1787365002.346044:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:3.0:1787365002.830591:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365003.284276:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c0616ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714123136:0@lo:400:kworker.0 00000100:00100000:0.0:1787365003.284383:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365003.284441:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714123648:0@lo:400:kworker.0 00000100:00100000:0.0:1787365003.284475:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365003.284506:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365003.284513:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c0616e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714123520:0@lo:400:kworker.0 00000100:00100000:0.0:1787365003.284551:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365003.284587:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c0616c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714123264:0@lo:400:kworker.0 00000100:00100000:0.0:1787365003.284614:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365003.284631:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714123776:0@lo:400:kworker.0 00000100:00100000:0.0:1787365003.284652:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365003.284670:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365003.284675:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c0616c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714123392:0@lo:400:kworker.0 00000100:00100000:0.0:1787365003.284699:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365003.285091:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714123136 00000100:00100000:2.0:1787365003.285101:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714123136 00000100:00100000:2.0:1787365003.285167:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787365003.285179:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714123136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285256:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714123136:12345-0@lo:400:kworker.0 Request processed in 79us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365003.285265:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787365003.285311:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714123520 00000100:00100000:2.0:1787365003.285316:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714123520 00000100:00100000:2.0:1787365003.285365:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714123776 00000100:00100000:2.0:1787365003.285369:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714123776 00000100:00100000:2.0:1787365003.285396:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787365003.285402:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714123520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285438:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714123520:12345-0@lo:400:kworker.0 Request processed in 36us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365003.285445:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787365003.285456:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787365003.285462:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285497:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714123776:12345-0@lo:400:kworker.0 Request processed in 35us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365003.285513:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787365003.285538:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714123648 00000100:00100000:2.0:1787365003.285552:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714123648 00000100:00100000:2.0:1787365003.285589:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714123264 00000100:00100000:2.0:1787365003.285592:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714123264 00000100:00100000:2.0:1787365003.285603:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714123392 00000100:00100000:2.0:1787365003.285606:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714123392 00000100:00100000:2.0:1787365003.285621:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787365003.285627:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714123648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285665:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714123648:12345-0@lo:400:kworker.0 Request processed in 38us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365003.285671:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787365003.285681:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787365003.285687:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714123264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285713:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714123264:12345-0@lo:400:kworker.0 Request processed in 26us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365003.285718:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787365003.285728:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787365003.285734:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714123392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285759:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714123392:12345-0@lo:400:kworker.0 Request processed in 26us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365003.285764:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787365003.285845:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c0616e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714123520:0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285859:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c0616ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714123136:0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285870:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714123648:0@lo:400:kworker.0 00000100:00080000:2.0:1787365003.285920:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787365003.285926:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365003.285928:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365003.285959:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c0616c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714123392:0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285971:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c0616c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714123264:0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.285981:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714123776:0@lo:400:kworker.0 00000100:00100000:2.0:1787365003.790101:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365003.790199:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714123904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365003.790378:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365003.790710:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714123904 00000100:00100000:3.0:1787365003.790726:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714123904 00000100:00100000:3.0:1787365003.790828:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787365003.790842:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714123904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365003.790895:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365003.791016:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714123904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365003.791026:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787365003.791079:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c0616c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714124032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365003.791129:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365003.791441:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714124032 00000100:00100000:3.0:1787365003.791449:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714124032 00000100:00100000:3.0:1787365003.791489:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787365003.791497:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714124032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365003.791903:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365003.792108:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714124032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 610us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365003.792118:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787365003.792183:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c0616c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714124032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365003.793130:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714123904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787365003.852909:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787365003.913610:0:12787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:16:40 (1787365000) 00010000:00010000:3.0:1787365004.875208:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365005.906470:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365006.112069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365006.112118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365006.112159:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365006.112185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365006.112211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365006.112243:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688973824 00000100:00100000:0.0:1787365006.112252:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688973824 00000100:00100000:0.0:1787365006.112310:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688973696 00000100:00100000:0.0:1787365006.112314:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688973696 00000100:00100000:0.0:1787365006.112339:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 114 00000100:00100000:0.0:1787365006.112348:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688973824:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365006.112438:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+7:2365:x1874187688973824:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365006.112446:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 114 00000100:00100000:0.0:1787365006.112463:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 115 00000100:00100000:0.0:1787365006.112480:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:2364:x1874187688973696:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365006.112517:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b97b2b3-6991-434b-88a0-aee779536483+5:2364:x1874187688973696:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 47us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365006.112524:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 115 00000100:00100000:0.0:1787365006.112548:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688973568 00000100:00100000:0.0:1787365006.112551:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688973568 00000100:00100000:0.0:1787365006.112583:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688973952 00000100:00100000:0.0:1787365006.112586:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688973952 00000100:00100000:0.0:1787365006.112607:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 187 00000100:00100000:0.0:1787365006.112613:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+18:2365:x1874187688973568:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365006.112645:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+18:2365:x1874187688973568:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 32us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365006.112650:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 187 00000100:00100000:0.0:1787365006.112670:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 188 00000100:00100000:0.0:1787365006.112677:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2364:x1874187688973952:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365006.112705:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2364:x1874187688973952:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365006.112711:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 188 00000100:00080000:0.0:1787365006.112728:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787365006.112733:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787365006.112735:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365006.113325:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688973440 00000100:00100000:3.0:1787365006.113333:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688973440 00000100:00100000:3.0:1787365006.113381:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 312 00000100:00100000:3.0:1787365006.113388:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688973440:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787365006.113453:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688973440:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 66us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365006.113461:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 312 00010000:00010000:2.0:1787365006.923060:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365007.946955:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365008.397048:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714124416:0@lo:400:kworker.0 00000100:00100000:1.0:1787365008.397142:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365008.397216:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787365008.397222:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714124288:0@lo:400:kworker.0 00000100:00100000:1.0:1787365008.397246:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365008.397272:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714124800:0@lo:400:kworker.0 00000100:00100000:1.0:1787365008.397297:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365008.399461:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714124160:0@lo:400:kworker.0 00000100:00100000:3.0:1787365008.399541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365008.399604:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714124672:0@lo:400:kworker.0 00000100:00100000:3.0:1787365008.399634:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365008.399662:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365008.399669:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714124544:0@lo:400:kworker.0 00000100:00100000:3.0:1787365008.399692:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365008.399834:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714124416 00000100:00100000:0.0:1787365008.399843:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714124416 00000100:00100000:0.0:1787365008.399908:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714124288 00000100:00100000:0.0:1787365008.399911:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714124288 00000100:00100000:0.0:1787365008.399925:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714124672 00000100:00100000:0.0:1787365008.399927:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714124672 00000100:00100000:0.0:1787365008.399942:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787365008.399951:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714124416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365008.400012:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714124416:12345-0@lo:400:kworker.0 Request processed in 63us (2871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365008.400019:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787365008.400036:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787365008.400041:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714124288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365008.400069:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714124288:12345-0@lo:400:kworker.0 Request processed in 28us (2822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365008.400074:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787365008.400094:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787365008.400099:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714124672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365008.400122:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714124672:12345-0@lo:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365008.400139:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787365008.400161:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714124800 00000100:00100000:0.0:1787365008.400164:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714124800 00000100:00100000:0.0:1787365008.400186:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714124544 00000100:00100000:0.0:1787365008.400188:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714124544 00000100:00100000:0.0:1787365008.400206:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787365008.400214:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714124800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365008.400244:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714124800:12345-0@lo:400:kworker.0 Request processed in 32us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365008.400249:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787365008.400258:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787365008.400263:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714124544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365008.400286:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714124544:12345-0@lo:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365008.400291:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787365008.400829:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714124160 00000100:00100000:1.0:1787365008.400835:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714124160 00000100:00100000:1.0:1787365008.400874:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787365008.400882:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714124160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365008.400921:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714124160:12345-0@lo:400:kworker.0 Request processed in 41us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365008.400928:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787365008.400984:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714124288:0@lo:400:kworker.0 00000100:00100000:1.0:1787365008.400998:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714124800:0@lo:400:kworker.0 00000100:00100000:1.0:1787365008.401010:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714124416:0@lo:400:kworker.0 00000100:00080000:3.0:1787365008.401218:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787365008.401224:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787365008.401227:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365008.401248:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714124544:0@lo:400:kworker.0 00000100:00100000:3.0:1787365008.401259:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d34243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714124160:0@lo:400:kworker.0 00000100:00100000:3.0:1787365008.401269:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714124672:0@lo:400:kworker.0 00000100:00100000:3.0:1787365008.907744:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365008.907772:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c0616e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714124928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365008.907873:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365008.908265:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714124928 00000100:00100000:2.0:1787365008.908274:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714124928 00000100:00100000:2.0:1787365008.908332:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787365008.908343:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714124928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365008.908393:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365008.908629:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714124928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 288us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365008.908638:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787365008.918030:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c0616e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714124928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365008.919898:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787365008.919923:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714125056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365008.920011:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365008.920111:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714125056 00000100:00100000:3.0:1787365008.920121:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714125056 00000100:00100000:3.0:1787365008.920184:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787365008.920195:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714125056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365008.920244:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365008.920313:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714125056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365008.920321:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787365008.938386:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714125056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787365008.971036:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365009.321841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365009.322183:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688974208 00000100:00100000:2.0:1787365009.322196:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688974208 00000100:00100000:2.0:1787365009.322337:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 66 00000100:00100000:2.0:1787365009.322350:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+18:12332:x1874187688974208:12345-192.168.204.2@tcp:35:umount.0 00000100:00100000:2.0:1787365009.323094:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+19:12332:x1874187688974208:12345-192.168.204.2@tcp:35:umount.0 Request processed in 743us (1261us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787365009.323104:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 66 00000100:00080000:3.0:1787365009.335040:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365009.335236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365009.335330:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688974464 00000100:00100000:1.0:1787365009.335342:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688974464 00000100:00100000:1.0:1787365009.335407:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 67 00000100:00100000:1.0:1787365009.335417:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+19:12332:x1874187688974464:12345-192.168.204.2@tcp:35:umount.0 00000100:00100000:1.0:1787365009.335890:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+20:12332:x1874187688974464:12345-192.168.204.2@tcp:35:umount.0 Request processed in 473us (659us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787365009.335899:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 67 00000100:00100000:0.0:1787365009.346805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365009.346945:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688974720 00000100:00100000:1.0:1787365009.346959:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688974720 00000100:00100000:1.0:1787365009.347166:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 68 00000100:00100000:1.0:1787365009.347179:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0553ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+20:12332:x1874187688974720:12345-192.168.204.2@tcp:35:umount.0 00000100:00100000:1.0:1787365009.348317:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0553ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b97b2b3-6991-434b-88a0-aee779536483+21:12332:x1874187688974720:12345-192.168.204.2@tcp:35:umount.0 Request processed in 1134us (1527us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787365009.348336:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 68 00000100:00100000:0.0:1787365009.354887:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365009.365892:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688974976 00000100:00100000:2.0:1787365009.365908:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688974976 00000100:00100000:2.0:1787365009.365996:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:2.0:1787365009.366008:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+21:12332:x1874187688974976:12345-192.168.204.2@tcp:35:umount.0 00000100:00100000:2.0:1787365009.366393:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b97b2b3-6991-434b-88a0-aee779536483+22:12332:x1874187688974976:12345-192.168.204.2@tcp:35:umount.0 Request processed in 386us (11516us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787365009.366402:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 69 00000100:00100000:0.0:1787365009.376011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365009.376049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365009.376084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365009.376222:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688975232 00000100:00100000:3.0:1787365009.376233:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688975232 00000100:00100000:3.0:1787365009.376288:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688975104 00000100:00100000:3.0:1787365009.376292:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688975104 00000100:00100000:3.0:1787365009.376304:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688975360 00000100:00100000:3.0:1787365009.376306:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688975360 00000100:00100000:3.0:1787365009.376323:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:3.0:1787365009.376331:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07003850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+15:2364:x1874187688975232:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365009.376352:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365009.376374:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e34c00/0xcfc9272e5fc2ae41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da46 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365009.376394:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365009.376480:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07003850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+14:2364:x1874187688975232:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 149us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365009.376488:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:3.0:1787365009.376542:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:3.0:1787365009.376549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+13:2364:x1874187688975104:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365009.376571:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365009.376582:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28334600/0xcfc9272e5fc2aedb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da7e expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365009.376594:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365009.376613:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+12:2364:x1874187688975104:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 65us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365009.376636:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:3.0:1787365009.376650:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:3.0:1787365009.376656:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+11:2364:x1874187688975360:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365009.376664:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365009.376680:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e5800/0xcfc9272e5fc2b0ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db49 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365009.376687:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365009.376717:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2364:x1874187688975360:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 61us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365009.376723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:2.0:1787365009.384559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365009.384774:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688975744 00000100:00100000:0.0:1787365009.384845:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688975744 00000100:00100000:0.0:1787365009.385134:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 72 00000100:00100000:0.0:1787365009.385150:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+7:2363:x1874187688975744:12345-192.168.204.2@tcp:9:umount.0 00000020:00000080:0.0:1787365009.385202:0:6710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2b414 00000020:00010000:0.0:1787365009.385211:0:6710:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b6d407fa800: total 0 00000100:00080000:0.0:1787365009.385217:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9b6d407fd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787365009.385267:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787365009.385583:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b97b2b3-6991-434b-88a0-aee779536483+5:2363:x1874187688975744:12345-192.168.204.2@tcp:9:umount.0 Request processed in 437us (1036us total) trans 0 rc 0/0 00000020:00010000:2.0:1787365009.385629:0:5845:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b6d407fa800: total 0 00010000:00010000:2.0:1787365009.385666:0:5845:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b6d407fa800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787365009.385735:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007c1e8e2/0xcfc9272e5fc2b7b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd1e expref: 5 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365009.385769:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000701e18ec/0xcfc9272e5fc2be55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67deec expref: 4 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365009.385809:0:5845:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b6d407fa800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787365009.385822:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365009.385824:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365009.385835:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365009.386067:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365009.387391:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 72 00000100:00100000:0.0:1787365009.391364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365009.395258:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688975872 00000100:00100000:2.0:1787365009.395273:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688975872 00000100:00100000:2.0:1787365009.395361:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 73 00000100:00100000:2.0:1787365009.395372:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+5:2363:x1874187688975872:12345-192.168.204.2@tcp:9:umount.0 00000020:00000080:2.0:1787365009.395417:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2b1b3 00000100:00080000:2.0:1787365009.395437:0:6709:0:(import.c:65:import_set_state_nolock()) ffff9b6d02c4b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787365009.395476:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787365009.395821:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b97b2b3-6991-434b-88a0-aee779536483+2:2363:x1874187688975872:12345-192.168.204.2@tcp:9:umount.0 Request processed in 450us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365009.395830:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 73 00010000:00010000:2.0:1787365009.395851:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365009.402706:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365009.409665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365009.409911:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688976896 00000100:00100000:0.0:1787365009.409925:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688976896 00000100:00100000:0.0:1787365009.410012:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 240 00000100:00100000:0.0:1787365009.410023:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+22:2363:x1874187688976896:12345-192.168.204.2@tcp:39:umount.0 00000020:00000080:0.0:1787365009.410056:0:8228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ae4f 00000020:00010000:0.0:1787365009.410074:0:8228:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b6d06349800: total 0 00000100:00080000:0.0:1787365009.410079:0:8228:0:(import.c:65:import_set_state_nolock()) ffff9b6c06f86800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787365009.410146:0:8228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787365009.410554:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b97b2b3-6991-434b-88a0-aee779536483+21:2363:x1874187688976896:12345-192.168.204.2@tcp:39:umount.0 Request processed in 531us (901us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787365009.410563:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 240 00000020:00010000:1.0:1787365009.415138:0:5845:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b6d06349800: total 0 00010000:00010000:1.0:1787365009.415149:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365009.415275:0:5845:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b6d06349800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787365009.415314:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787365009.415318:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787365009.415330:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0400/0xcfc9272e5fc2be40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dee5 expref: 20 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415363:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d104f9700) 00010000:00010000:0.0:1787365009.415366:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365009.415389:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35400/0xcfc9272e5fc2b119 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db57 expref: 19 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415414:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787365009.415417:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787365009.415421:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030a00/0xcfc9272e5fc2b7a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd17 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415447:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:0.0:1787365009.415450:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787365009.415454:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0600/0xcfc9272e5fc2bb14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de13 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415466:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787365009.415468:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365009.415471:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40879c00/0xcfc9272e5fc2b698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dcd1 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415484:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787365009.415486:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787365009.415490:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40e35a00/0xcfc9272e5fc2b189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db73 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415501:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787365009.415503:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365009.415507:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0c00/0xcfc9272e5fc2bd36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67de9f expref: 14 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415520:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:0.0:1787365009.415529:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787365009.415534:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2b476 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dc45 expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415554:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d104f9300) 00010000:00010000:0.0:1787365009.415557:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787365009.415561:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2b835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd41 expref: 12 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415576:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:0.0:1787365009.415579:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365009.415582:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2b819 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd3a expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415594:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d3c6a8e00) 00010000:00010000:0.0:1787365009.415597:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365009.415600:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2b135 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db5e expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415612:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d12906300) 00010000:00010000:0.0:1787365009.415614:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365009.415617:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449000/0xcfc9272e5fc2b778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dd09 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415630:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787365009.415632:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365009.415636:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2be16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67ded7 expref: 8 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365009.415660:0:5845:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b6d06349800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787365009.415672:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365009.415675:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365009.415676:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787365009.487998:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:2.0:1787365009.488007:0:6733:0:(genops.c:885:class_export_put()) final put ffff9b6d02c4f800/6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:1.0:1787365009.488121:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d02c4f800/6b97b2b3-6991-434b-88a0-aee779536483 for lustre-OST0000 00000020:00000080:1.0:1787365009.488169:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d02c4b800 for lustre-OST0000 00010000:00010000:2.0:1787365009.995080:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365011.018923:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365011.229467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365011.229529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365011.229720:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688977024 00000100:00100000:0.0:1787365011.229732:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688977024 00000100:00100000:0.0:1787365011.229835:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 314 00000100:00100000:0.0:1787365011.229847:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2364:x1874187688977024:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365011.229951:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf99abb4-88a3-48fa-9491-b4225d983398+10:2364:x1874187688977024:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 106us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365011.229959:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 314 00000100:00100000:1.0:1787365011.230750:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688977152 00000100:00100000:1.0:1787365011.230765:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688977152 00000100:00100000:1.0:1787365011.230897:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 192 00000100:00100000:1.0:1787365011.230908:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c0616dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2364:x1874187688977152:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365011.231013:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c0616dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2364:x1874187688977152:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 106us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365011.231021:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 192 00000100:00080000:3.0:1787365011.231473:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787365011.468350:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787365011.468367:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787365011.469898:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787365011.469910:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787365011.747926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365011.747970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365011.748046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365011.748250:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688977280 00000100:00100000:3.0:1787365011.748261:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688977280 00000100:00100000:3.0:1787365011.748310:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688977536 00000100:00100000:3.0:1787365011.748313:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688977536 00000100:00100000:3.0:1787365011.748328:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688977408 00000100:00100000:3.0:1787365011.748330:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688977408 00000100:00100000:3.0:1787365011.748347:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:3.0:1787365011.748357:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+12:2367:x1874187688977280:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365011.748394:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365011.748422:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e5600/0xcfc9272e5fc2af21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da93 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365011.748443:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365011.748514:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+11:2367:x1874187688977280:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 159us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365011.748522:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:3.0:1787365011.748543:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:3.0:1787365011.748550:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+10:2366:x1874187688977536:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365011.748559:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365011.748569:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e4c00/0xcfc9272e5fc2b0da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67db42 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365011.748579:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365011.750249:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+9:2366:x1874187688977536:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 1687us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365011.750262:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:3.0:1787365011.750296:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:3.0:1787365011.750308:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+8:2364:x1874187688977408:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365011.750324:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365011.750342:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e35c00/0xcfc9272e5fc2af28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dabd expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365011.750356:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365011.750421:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf99abb4-88a3-48fa-9491-b4225d983398+7:2364:x1874187688977408:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 111us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365011.750429:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:2.0:1787365011.763893:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365011.764411:0:8228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688977792 00000100:00100000:0.0:1787365011.764421:0:8228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688977792 00000100:00100000:0.0:1787365011.764484:0:8228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 241 00000100:00100000:0.0:1787365011.764495:0:8228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+6:2363:x1874187688977792:12345-192.168.204.2@tcp:39:umount.0 00000020:00000080:0.0:1787365011.764540:0:8228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2af36 00000020:00010000:0.0:1787365011.764549:0:8228:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b6c04a21000: total 0 00000100:00080000:0.0:1787365011.764554:0:8228:0:(import.c:65:import_set_state_nolock()) ffff9b6c04a23800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787365011.764588:0:8228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787365011.764858:0:8228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41d9d144-3b1e-4bea-b859-eec032afe3d5+5:2363:x1874187688977792:12345-192.168.204.2@tcp:39:umount.0 Request processed in 364us (975us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787365011.764867:0:8228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 241 00000020:00010000:1.0:1787365011.765693:0:5844:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b6c04a21000: total 0 00010000:00010000:1.0:1787365011.765746:0:5844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b6c04a21000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787365011.765777:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d10b29700) 00010000:00010000:1.0:1787365011.765782:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365011.765826:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d013c9600/0xcfc9272e5fc2be63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67def3 expref: 4 pid: 8228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365011.765852:0:5844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b6c04a21000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787365011.765868:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365011.765870:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365011.765871:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365011.805940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365011.806036:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688978048 00000100:00100000:3.0:1787365011.806048:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688978048 00000100:00100000:3.0:1787365011.806107:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 315 00000100:00100000:3.0:1787365011.806117:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+7:2363:x1874187688978048:12345-192.168.204.2@tcp:251:umount.0 00000020:00000080:3.0:1787365011.806165:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ae2c 00000020:00010000:3.0:1787365011.806172:0:5851:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b6c06b0d000: total 0 00000100:00080000:3.0:1787365011.806177:0:5851:0:(import.c:65:import_set_state_nolock()) ffff9b6c06b0f800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787365011.806256:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf99abb4-88a3-48fa-9491-b4225d983398+3:2363:x1874187688978048:12345-192.168.204.2@tcp:251:umount.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365011.806264:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 315 00000020:00010000:0.0:1787365011.806435:0:5845:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b6c06b0d000: total 0 00010000:00010000:0.0:1787365011.806440:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365011.806484:0:5845:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b6c06b0d000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787365011.806541:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2aee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67da85 expref: 2 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365011.806557:0:5845:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b6c06b0d000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787365011.806567:0:5845:0:(genops.c:885:class_export_put()) final put ffff9b6c06b0d000/cf99abb4-88a3-48fa-9491-b4225d983398 00010000:00010000:0.0:1787365011.806588:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365011.806590:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365011.806592:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787365011.806628:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c06b0d000/cf99abb4-88a3-48fa-9491-b4225d983398 for MGS 00000020:00000080:3.0:1787365011.806676:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6c06b0f800 for MGS 00010000:00010000:1.0:1787365012.043946:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787365012.554539:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:1.0:1787365012.554548:0:7661:0:(genops.c:885:class_export_put()) final put ffff9b6d407fa800/6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:1.0:1787365012.554601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d407fa800/6b97b2b3-6991-434b-88a0-aee779536483 for lustre-OST0001 00000020:00000080:1.0:1787365012.554654:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d407fd000 for lustre-OST0001 00000001:00100000:2.0:1787365012.586766:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41d9d144-3b1e-4bea-b859-eec032afe3d5 00000001:00080000:2.0:1787365012.586815:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787365012.586821:0:5878:0:(genops.c:885:class_export_put()) final put ffff9b6c04a21000/41d9d144-3b1e-4bea-b859-eec032afe3d5 00000001:00100000:2.0:1787365012.586843:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6b97b2b3-6991-434b-88a0-aee779536483 00000001:00080000:2.0:1787365012.586850:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787365012.586865:0:5878:0:(genops.c:885:class_export_put()) final put ffff9b6d06349800/6b97b2b3-6991-434b-88a0-aee779536483 00000020:00000080:1.0:1787365012.587047:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c04a21000/41d9d144-3b1e-4bea-b859-eec032afe3d5 for lustre-MDT0000 00000020:00000080:1.0:1787365012.587113:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d06349800/6b97b2b3-6991-434b-88a0-aee779536483 for lustre-MDT0000 00000020:00000080:1.0:1787365012.587144:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6c04a23800 for lustre-MDT0000 00000020:00000080:1.0:1787365012.587149:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6c06f86800 for lustre-MDT0000 00010000:00010000:3.0:1787365013.067137:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365013.519017:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714125184:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519093:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365013.519159:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714125696:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365013.519217:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365013.519222:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714125568:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519248:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365013.519279:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714125312:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519304:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365013.519322:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714125824:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519368:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365013.519402:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365013.519407:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714125440:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519444:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365013.519481:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714125184 00000100:00100000:3.0:1787365013.519490:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714125184 00000100:00100000:3.0:1787365013.519534:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787365013.519544:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714125184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519597:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d02fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714125184:12345-0@lo:400:kworker.0 Request processed in 55us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365013.519604:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787365013.519651:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714125696 00000100:00100000:3.0:1787365013.519655:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714125696 00000100:00100000:3.0:1787365013.519693:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714125312 00000100:00100000:3.0:1787365013.519696:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714125312 00000100:00100000:3.0:1787365013.519708:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714125440 00000100:00100000:3.0:1787365013.519711:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714125440 00000100:00100000:3.0:1787365013.519726:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787365013.519732:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714125696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519778:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874187714125696:12345-0@lo:400:kworker.0 Request processed in 33us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365013.519807:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787365013.519818:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787365013.519824:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714125312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519854:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714125312:12345-0@lo:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365013.519861:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787365013.519871:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787365013.519877:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714125440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.519902:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714125440:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365013.519915:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787365013.519932:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714125568 00000100:00100000:3.0:1787365013.519936:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714125568 00000100:00100000:3.0:1787365013.519960:0:12088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714125824 00000100:00100000:3.0:1787365013.519963:0:12088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714125824 00000100:00100000:3.0:1787365013.519978:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787365013.519984:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714125568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.520014:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714125568:12345-0@lo:400:kworker.0 Request processed in 30us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365013.520020:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787365013.520030:0:12088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787365013.520036:0:12088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714125824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.520061:0:12088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714125824:12345-0@lo:400:kworker.0 Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365013.520067:0:12088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787365013.520110:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714125568:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.520119:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714125184:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.520127:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1874187714125696:0@lo:400:kworker.0 00000100:00080000:3.0:1787365013.520151:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787365013.520154:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787365013.520157:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365013.520174:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714125440:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.520184:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714125312:0@lo:400:kworker.0 00000100:00100000:3.0:1787365013.520192:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714125824:0@lo:400:kworker.0 00000100:00100000:2.0:1787365014.030214:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365014.030236:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714125952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365014.030306:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365014.030391:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714125952 00000100:00100000:2.0:1787365014.030399:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714125952 00000100:00100000:0.0:1787365014.030436:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714126080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365014.030447:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787365014.030455:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714125952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365014.030467:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787365014.030507:0:8230:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365014.030507:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714126080 00000100:00100000:0.0:1787365014.030511:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714126080 00000100:00100000:0.0:1787365014.030531:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787365014.030537:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714126080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365014.030557:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365014.030560:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714125952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365014.030567:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787365014.030586:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714126080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365014.030591:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787365014.030612:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714125952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365014.030612:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714126080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787365014.092743:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787365014.669475:0:12988:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787365014.705140:0:12988:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787365014.705191:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.705208:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.705216:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.705224:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.705244:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787365014.705250:0:12988:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787365014.705278:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787365014.705284:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787365014.705290:0:12988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787365014.705340:0:12988:0:(import.c:65:import_set_state_nolock()) ffff9b6d33f25000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787365014.705531:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714126208:0@lo:39:umount.0 00000100:00100000:0.0:1787365014.705609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365014.706029:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714126208 00000100:00100000:1.0:1787365014.706037:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714126208 00000100:00100000:1.0:1787365014.706204:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787365014.706226:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874187714126208:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787365014.706254:0:5858:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ac3b 00000100:00080000:1.0:1787365014.706262:0:5858:0:(import.c:65:import_set_state_nolock()) ffff9b6d35514000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787365014.706437:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365014.706445:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.706454:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5a00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:2.0:1787365014.706459:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.706468:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365014.706475:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365014.706481:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787365014.706483:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787365014.706486:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787365014.706527:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.706533:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365014.706556:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.706563:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5a00/0xcfc9272e5fc2aeb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aeb8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.706575:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365014.706577:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365014.706579:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365014.706591:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714126336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787365014.706873:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365014.707194:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365014.707281:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714126336 00000100:00100000:0.0:1787365014.707288:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714126336 00000100:00100000:0.0:1787365014.707380:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787365014.707389:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3314:x1874187714126336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365014.707401:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365014.707414:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28334e00/0xcfc9272e5fc2aeb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2aeb1 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365014.707436:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365014.707475:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:3314:x1874187714126336:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365014.707482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365014.707549:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714126336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365014.708235:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3312:x1874187714126208:12345-0@lo:39:umount.0 Request processed in 2008us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365014.708245:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787365014.708255:0:5858:0:(genops.c:885:class_export_put()) final put ffff9b6d35514800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787365014.708328:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d35514800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787365014.708379:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d35514000 for lustre-MDT0000 00000100:00080000:2.0:1787365014.708498:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d33f25000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787365014.708513:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714126208:0@lo:39:umount.0 00000100:00080000:1.0:1787365014.708561:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787365014.708565:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787365014.708570:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787365014.710005:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.710024:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.710031:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.710038:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.710182:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365014.710190:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.710196:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.710202:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.710223:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711241:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787365014.711251:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711261:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0200 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:2.0:1787365014.711265:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711275:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365014.711282:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365014.711312:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787365014.711315:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787365014.711361:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711367:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365014.711406:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711414:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2aebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aec6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711426:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365014.711429:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711435:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0000 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:2.0:1787365014.711438:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711444:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365014.711449:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365014.711454:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787365014.711456:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787365014.711467:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711478:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365014.711486:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.711494:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365014.711495:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365014.711497:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365014.711563:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714126464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365014.711641:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365014.711695:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365014.711711:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714126592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365014.711734:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365014.712055:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714126464 00000100:00100000:2.0:1787365014.712063:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714126464 00000100:00100000:2.0:1787365014.712109:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714126592 00000100:00100000:2.0:1787365014.712111:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714126592 00000100:00100000:2.0:1787365014.712125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787365014.712133:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d07001450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+19:3315:x1874187714126464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787365014.712145:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365014.712158:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e34200/0xcfc9272e5fc2aec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2aebf expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.712171:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365014.712203:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d07001450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+18:3315:x1874187714126464:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365014.712210:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787365014.712248:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787365014.712254:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+17:3315:x1874187714126592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787365014.712259:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365014.712266:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00030400/0xcfc9272e5fc2aded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2ade6 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.712277:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365014.712393:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714126592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365014.712401:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714126464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787365014.712465:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3315:x1874187714126592:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365014.712472:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787365014.712564:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787365014.712574:0:12988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2ade6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aded expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365014.712587:0:12988:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787365014.712596:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.712603:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.712610:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.712617:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.712649:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365014.712655:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.712661:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787365014.712663:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.712670:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365014.712677:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365014.712682:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787365014.712689:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787365014.712717:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.712723:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787365014.712765:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714126720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365014.712831:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365014.712898:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714126720 00000100:00100000:2.0:1787365014.712903:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714126720 00000100:00100000:2.0:1787365014.712930:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787365014.712936:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3313:x1874187714126720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787365014.712944:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365014.712952:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e34000/0xcfc9272e5fc2b0e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0e1 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365014.712963:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365014.713024:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.713034:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365014.713036:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365014.713037:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365014.713254:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787365014.713259:0:12988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d342e5e00/0xcfc9272e5fc2b0e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2b0e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365014.713269:0:12988:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787365014.713286:0:12988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.713292:0:12988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.713327:0:12988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.713335:0:12988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365014.713346:0:12988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787365014.713349:0:12988:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787365014.713353:0:12988:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787365014.713382:0:12988:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787365014.713387:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787365014.713391:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365014.713397:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787365014.713402:0:12988:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b6d202d6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787365014.713407:0:12988:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b6c04918800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787365014.713411:0:12988:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9b6d05530000) has exports, disconnecting them 00000020:00080000:1.0:1787365014.713415:0:12988:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b6d202d6000), last request at 1787365013 00000020:00000080:1.0:1787365014.713421:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2adae 00000100:00080000:1.0:1787365014.713437:0:12988:0:(import.c:65:import_set_state_nolock()) ffff9b6d202d4800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787365014.713476:0:12988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d202d6000): rc 0 00000020:00000080:1.0:1787365014.713479:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d202d6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787365014.713494:0:12988:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b6c04918800), last request at 1787365013 00000020:00000080:1.0:1787365014.713497:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ace3 00000100:00080000:1.0:1787365014.713503:0:12988:0:(import.c:65:import_set_state_nolock()) ffff9b6c04919800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787365014.713513:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d202d6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787365014.713546:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d202d4800 for lustre-MDT0000 00000020:00080000:1.0:1787365014.713558:0:12988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6c04918800): rc 0 00000020:00000080:1.0:1787365014.713565:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6c04918800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787365014.713574:0:12988:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb71e014f3ae0 00000020:00000080:1.0:1787365014.713586:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c04918800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787365014.713605:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6c04919800 for lustre-MDT0000 00000100:00080000:1.0:1787365014.713623:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787365014.713627:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787365014.713639:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787365014.713715:0:12988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787365014.713731:0:12988:0:(import.c:65:import_set_state_nolock()) ffff9b6d202d2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787365014.713744:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787365014.713746:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787365014.713754:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787365014.713836:0:12988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787365014.713844:0:12988:0:(import.c:65:import_set_state_nolock()) ffff9b6d20568800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787365014.713870:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b6d05530000) has no exports 00010000:00010000:3.0:1787365014.714069:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365014.714075:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.714094:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c9000 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787365014.714097:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.714105:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365014.714112:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365014.714117:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787365014.714119:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787365014.714121:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787365014.714143:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.714149:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365014.714178:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.714185:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2ab9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2aba1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.714198:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365014.714199:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365014.714201:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365014.714207:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365014.714434:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714127104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365014.714483:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365014.714571:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787365014.714580:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787365014.714933:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714127104 00000100:00100000:1.0:1787365014.714940:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714127104 00000100:00100000:3.0:1787365014.715056:0:12989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787365014.715064:0:12989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8853f36b-eb15-4321-aed5-724dfa11fdc2+16:3314:x1874187714127104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787365014.715076:0:12989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365014.715090:0:12989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2aba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2ab9a expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365014.715104:0:12989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365014.715147:0:12989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8853f36b-eb15-4321-aed5-724dfa11fdc2+15:3314:x1874187714127104:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365014.715154:0:12989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787365014.715212:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8853f36b-eb15-4321-aed5-724dfa11fdc2:3314:1874187714127104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787365014.715279:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8853f36b-eb15-4321-aed5-724dfa11fdc2+14:3313:x1874187714126720:12345-0@lo:103:ldlm_bl.0 Request processed in 2341us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365014.715286:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787365014.715382:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714126848:0@lo:9:umount.0 00000100:00100000:2.0:1787365014.715416:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365014.715444:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714126976:0@lo:9:umount.0 00000100:00100000:2.0:1787365014.715463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365014.715882:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714126848 00000100:00100000:1.0:1787365014.715888:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714126848 00000100:00100000:1.0:1787365014.715921:0:8229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714126976 00000100:00100000:1.0:1787365014.715924:0:8229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714126976 00000100:00100000:1.0:1787365014.715945:0:8229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787365014.715953:0:8229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874187714126848:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787365014.715975:0:8229:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ad30 00000100:00080000:1.0:1787365014.715985:0:8229:0:(import.c:65:import_set_state_nolock()) ffff9b6c0491a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787365014.716025:0:8229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787365014.716406:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787365014.716415:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874187714126976:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787365014.716427:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ae17 00000100:00080000:2.0:1787365014.716433:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9b6d0634a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787365014.716456:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787365014.716662:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3312:x1874187714126976:12345-0@lo:9:umount.0 Request processed in 248us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365014.716669:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1787365014.716695:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365014.716905:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714126720:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787365014.717388:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d20568800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787365014.717435:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:1.0:1787365014.717588:0:8229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3312:x1874187714126848:12345-0@lo:9:umount.0 Request processed in 1634us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365014.717596:0:8229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1787365014.717621:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787365014.718482:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787365014.718490:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714126976:0@lo:9:umount.0 00000100:00080000:2.0:1787365014.718521:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d202d2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787365014.718538:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787365014.718541:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787365014.718543:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714126848:0@lo:9:umount.0 00000020:00080000:1.0:1787365014.724630:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b6d05530000) has no exports 00000020:00000080:1.0:1787365014.838341:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2abf5 00000020:00000080:1.0:1787365014.838357:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d35511800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787365014.838381:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787365014.838592:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365014.838604:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787365014.838609:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9b6d04fdcd28) has no exports 00000020:00000080:0.0:1787365014.838982:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d35511800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787365014.841843:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2abee 00000020:00000080:2.0:1787365014.841858:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d35509000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787365014.841937:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365014.841949:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787365014.841952:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d3550f000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787365014.841955:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d3550f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787365014.841964:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787365014.842608:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d35509000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787365014.843232:0:12988:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6d40452f00 - data ffff9b6d303c61b0/ffff9b6c0621d400 00000020:01000000:2.0:1787365014.843415:0:12988:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6d0711d960 - data ffff9b6d02155360/ffff9b6d05559800 00000001:00000004:2.0:1787365014.868866:0:12988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787365015.002932:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787365015.002941:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787365015.002966:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787365015.002969:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787365015.003564:0:6930:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787365015.003569:0:6930:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787365015.003580:0:6930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787365015.005079:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787365015.005085:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787365015.005104:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787365015.005107:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787365015.007092:0:8063:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787365015.007098:0:8063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787365015.007110:0:8063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787365015.114348:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2abbd 00000020:00000080:1.0:1787365015.114361:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d40be0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787365015.115885:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2abd2 00000020:00000080:1.0:1787365015.115894:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d40be1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787365015.115901:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787365015.115905:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365015.115914:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787365015.115918:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9b6d055319b8) has no exports 00000020:00000080:0.0:1787365015.116230:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d40be0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787365015.116244:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d40be1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1787365015.116612:0:12988:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787365015.116624:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ae10 00000020:00000080:1.0:1787365015.116630:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6c06b0d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787365015.116682:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787365015.116688:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365015.116695:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787365015.116699:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9b6d344819b8) has no exports 00000020:00000080:1.0:1787365015.116705:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ae09 00000020:00000080:1.0:1787365015.116709:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d2056f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787365015.121162:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c06b0d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787365015.126433:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d2056f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787365015.127018:0:12988:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787365015.127024:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787365015.127028:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787365015.127055:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787365015.127057:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787365015.127113:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365015.127124:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787365015.127130:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ad29 00000020:00000080:1.0:1787365015.127138:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d202d1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787365015.127143:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787365015.127148:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365015.127152:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787365015.127156:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9b6d3ff58000) has no exports 00000020:00000080:1.0:1787365015.127162:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ad22 00000020:00000080:1.0:1787365015.127165:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d202d4000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787365015.127389:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d20568800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787365015.127396:0:8:0:(genops.c:885:class_export_put()) final put ffff9b6d202d5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787365015.127399:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d202d5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787365015.127406:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787365015.127481:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d202d1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787365015.127487:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d202d4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787365015.127892:0:12988:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787365015.127896:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787365015.127898:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787365015.127902:0:12988:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787365015.127904:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787365015.127972:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365015.127978:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787365015.128007:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365015.128010:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787365015.128014:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d2ffb7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787365015.128017:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d2ffb7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787365015.128024:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787365015.128184:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2abd9 00000020:00000080:1.0:1787365015.128190:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d40be6800/lustre-MDD0000_UUID 00010000:00010000:2.0:1787365015.128473:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787365015.131679:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d202d2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787365015.131696:0:8:0:(genops.c:885:class_export_put()) final put ffff9b6c0501d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787365015.131700:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c0501d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787365015.131727:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787365015.132203:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787365015.132211:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365015.132222:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787365015.132226:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9b6d34483370) has no exports 00000020:00000080:1.0:1787365015.132253:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365015.132259:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787365015.132272:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2abe0 00000020:00000080:1.0:1787365015.132279:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d40be6000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787365015.132288:0:12988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d20269000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787365015.132291:0:12988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6d20269000 3 00000020:01000004:1.0:1787365015.132308:0:12988:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6d20269000 from lustre-MDT0000 00000020:00000080:1.0:1787365015.132337:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365015.132341:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787365015.132344:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d40be1800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787365015.132346:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d40be1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787365015.132353:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787365015.132392:0:12988:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787365015.132396:0:12988:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787365015.132399:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787365015.132401:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365015.132404:0:12988:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787365015.132410:0:12988:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9b6d18df1000 8853f36b-eb15-4321-aed5-724dfa11fdc2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787365015.132415:0:12988:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9b6d05534d28) has exports, disconnecting them 00000020:00080000:1.0:1787365015.132419:0:12988:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b6d18df1000), last request at 1787364759 00000020:00000080:1.0:1787365015.132432:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ab7e 00000020:00010000:1.0:1787365015.132435:0:12988:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b6d18df1000: total 2 00000100:00080000:1.0:1787365015.132439:0:12988:0:(import.c:65:import_set_state_nolock()) ffff9b6d18df5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787365015.132452:0:12988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d18df1000): rc 0 00000020:00080000:1.0:1787365015.132455:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9b6d05534d28) has no exports 00000020:00010000:1.0:1787365015.132467:0:5845:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b6d18df1000: total 2 00010000:00010000:1.0:1787365015.132490:0:5845:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b6d18df1000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787365015.132520:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e34600/0xcfc9272e5fc2ae9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae95 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365015.132534:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28335e00/0xcfc9272e5fc2aeaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2aea3 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365015.132548:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c1600/0xcfc9272e5fc2b0d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0cc expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365015.132571:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c1400/0xcfc9272e5fc2b0c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2b0be expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365015.132585:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00031e00/0xcfc9272e5fc2ac96 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2ac8f expref: 5 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365015.132598:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d28334200/0xcfc9272e5fc2aed4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2aecd expref: 4 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365015.132608:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e5400/0xcfc9272e5fc2ae8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae87 expref: 3 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365015.132617:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40e35800/0xcfc9272e5fc2ae80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfc9272e5fc2ae79 expref: 2 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365015.132628:0:5845:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b6d18df1000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787365015.132641:0:5845:0:(genops.c:885:class_export_put()) final put ffff9b6d18df1000/8853f36b-eb15-4321-aed5-724dfa11fdc2 00010000:00010000:1.0:1787365015.132647:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365015.132650:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365015.132652:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365015.132754:0:5849:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b6d06244200:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1787365015.132872:0:5851:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b6d06353800:5851] 2 exiting: rc = 0 00000020:00000080:3.0:1787365015.132913:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d40be6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787365015.132918:0:8:0:(genops.c:885:class_export_put()) final put ffff9b6d40be7000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787365015.132920:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d40be7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787365015.132923:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787365015.133082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d40be6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787365015.133086:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d18df1000/8853f36b-eb15-4321-aed5-724dfa11fdc2 for MGS 00000020:00000080:3.0:1787365015.133125:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d18df5000 for MGS 00000100:00100000:2.0:1787365015.138526:0:5850:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b6d07d33a00:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1787365015.138915:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138924:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138931:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138939:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138944:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138951:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138957:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138963:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138968:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.138975:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139002:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139009:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139017:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139023:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139029:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139035:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139041:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139046:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139052:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139058:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139064:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139070:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139077:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139097:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139103:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139109:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139115:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139121:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139127:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139132:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139138:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139144:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139149:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139155:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139161:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139166:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139172:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139178:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139184:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139189:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139194:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139200:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139206:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139211:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139217:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139229:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139235:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139240:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139245:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139251:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139257:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139262:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139268:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139274:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139279:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139285:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139290:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139308:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139324:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139329:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139334:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139340:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139345:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365015.139350:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787365015.139879:0:12988:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787365015.139882:0:12988:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787365015.144631:0:12988:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6c053a5120 - data ffff9b6d37d08e58/ffff9b6d40184800 00000020:01000000:1.0:1787365015.144768:0:12988:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6d18c76900 - data ffff9b6d3bb8b000/ffff9b6d097c2800 00000020:00000080:1.0:1787365015.145420:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ab62 00000020:00000080:1.0:1787365015.145429:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d02d49000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787365015.145445:0:12988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d20269000 from MGS, refs=2 00000020:01000004:1.0:1787365015.145448:0:12988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6d20269000 2 00000020:01000004:1.0:1787365015.145452:0:12988:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6d20269000 from MGS 00000020:00000080:1.0:1787365015.145473:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365015.145479:0:12988:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787365015.145482:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d02d4e000/MGS 00000020:00000080:1.0:1787365015.145485:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d02d4e000/MGS for MGS 00000020:01000000:1.0:1787365015.145492:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787365015.145552:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787365015.145570:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365015.145577:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787365015.145584:0:12988:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b6d33f22000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787365015.145590:0:12988:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9b6d3ff5cd28) has exports, disconnecting them 00000020:00080000:1.0:1787365015.145595:0:12988:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b6d33f22000), last request at 1787364760 00000020:00000080:1.0:1787365015.145599:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ac2d 00000020:00080000:1.0:1787365015.145609:0:12988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d33f22000): rc 0 00000020:00000080:1.0:1787365015.145614:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d33f22000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787365015.146953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d02d49000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787365015.146966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d33f22000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787365015.149230:0:12988:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787365015.149240:0:12988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787365015.149244:0:12988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787365015.149253:0:12988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787365015.149285:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d33f25000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787365015.149475:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787365015.149485:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787365015.149493:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d02e62800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787365015.149498:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d02e62800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787365015.149504:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787365015.149571:0:12988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6d20269000 1 00000020:00000080:3.0:1787365015.149578:0:12988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ab54 00000020:00000080:3.0:1787365015.149585:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d02d4a000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787365015.149594:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787365015.149601:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d02d4a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787365015.149612:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787365015.149617:0:12988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787365015.149621:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9b6d05533370) has no exports 00000020:00000080:3.0:1787365015.222539:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787365015.222556:0:12988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787365015.222562:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d20269800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787365015.222567:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d20269800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787365015.222578:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787365015.223946:0:12988:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b6d2026d000 00000020:01000000:3.0:1787365015.223976:0:12988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787365015.223981:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787365015.223986:0:12988:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787365015.223991:0:12988:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9b6d04fdb370) has no exports 00000100:00100000:3.0:1787365015.224078:0:8228:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b6d407a3e00:8228] 3 exiting: rc = 0 00000100:00100000:3.0:1787365015.224249:0:5857:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b6d04fea200:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1787365015.224736:0:5858:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b6d04fea400:5858] 2 exiting: rc = 0 00000100:00100000:0.0:1787365015.233443:0:5856:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b6d04fea000:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1787365015.233645:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233653:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233660:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233665:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233671:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233677:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233683:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233688:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233695:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233717:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233728:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233734:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233739:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233744:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233749:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233755:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233759:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233764:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233772:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233777:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233823:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233831:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233853:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233858:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233863:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233870:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233876:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233881:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233887:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233892:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233898:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233903:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233908:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233914:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233919:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233924:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233929:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233935:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233941:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233946:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233952:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233958:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233985:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.233992:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234000:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234006:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234012:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234018:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234025:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234032:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234038:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234044:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234050:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234056:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234062:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234068:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234073:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234087:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234093:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234099:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234106:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234112:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234118:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.234124:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365015.241099:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b6d05509800:5859] 0 exiting: rc = 1 00000100:00100000:1.0:1787365015.241123:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b6d04feb600:5860] 1 exiting: rc = 0 00000100:00100000:3.0:1787365015.241216:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241227:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241237:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241245:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241254:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241263:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241272:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241280:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241288:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241511:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241517:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241524:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241530:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241536:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241542:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241547:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241553:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241559:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241564:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241569:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241574:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241579:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241584:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241589:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241594:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241599:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241604:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241609:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241664:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241669:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241675:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241680:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241685:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241690:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241696:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241701:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241706:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241710:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241714:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241719:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241725:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241730:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241735:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241741:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241746:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241751:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241756:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241761:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241766:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241771:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241777:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241934:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241942:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241947:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241952:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241957:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241962:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241967:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241973:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241978:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241984:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241990:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.241995:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.242008:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.251610:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b6d04feb200:5861] 0 exiting: rc = 1 00000100:00100000:3.0:1787365015.256845:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b6d05508e00:5862] 1 exiting: rc = 0 00000100:00100000:3.0:1787365015.256959:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.256968:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.256975:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257000:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257006:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257013:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257018:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257024:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257029:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257035:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257040:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257047:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257053:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257061:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257067:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257103:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257111:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257117:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257123:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257129:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257135:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257142:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257148:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257157:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257164:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257171:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257177:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257203:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257402:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257408:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257415:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257421:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257426:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257446:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257452:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257459:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257464:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257469:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257475:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257496:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257504:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257509:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257515:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257522:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257528:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257534:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257540:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257546:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257553:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257559:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257564:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257584:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257593:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257601:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257608:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257614:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257620:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257626:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257632:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257638:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257644:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257649:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257656:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.257677:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.279944:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b6d04feb800:5863] 0 exiting: rc = 1 00000100:00100000:3.0:1787365015.280953:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b6d06a79000:5864] 1 exiting: rc = 0 00000100:00100000:0.0:1787365015.281059:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281066:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281072:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281077:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281096:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281103:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281108:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281112:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281117:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281122:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281126:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281131:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281136:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281140:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281146:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281151:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281156:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281161:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281167:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281171:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281176:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281180:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281185:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281190:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281195:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281199:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281204:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281208:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281213:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281218:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281223:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281243:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281247:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281252:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281258:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281263:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281268:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281274:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281279:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281283:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281289:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281318:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281323:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281328:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281333:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281338:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281342:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281347:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281352:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281357:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281361:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281366:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281371:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281376:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281380:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281385:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281390:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281395:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281400:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281405:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281410:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281414:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281419:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281424:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.281942:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b6d06a78a00:5866] 1 exiting: rc = 0 00000100:00100000:3.0:1787365015.282964:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b6d06342e00:5865] 0 exiting: rc = 1 00000100:00100000:0.0:1787365015.283422:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283440:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283446:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283451:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283457:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283461:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283467:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283473:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283479:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283485:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283490:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283496:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283501:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283506:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283511:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283516:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283522:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283527:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283533:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283538:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283543:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283547:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283553:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283558:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283563:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283568:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283573:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283579:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283583:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283588:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283594:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283599:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283604:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283609:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283614:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.283619:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284129:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284135:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284141:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284146:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284152:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284158:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284163:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284168:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284174:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284179:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284185:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284190:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284195:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284201:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284206:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284211:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284216:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284221:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284226:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284231:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284237:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284242:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284247:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284252:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284257:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284262:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284268:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365015.284274:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286336:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b6d06350e00:5868] 1 exiting: rc = 0 00000100:00100000:3.0:1787365015.286438:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b6d06350800:5867] 0 exiting: rc = 1 00000100:00100000:3.0:1787365015.286492:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286499:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286505:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286510:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286516:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286521:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286527:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286619:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286631:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286640:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286646:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286651:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286657:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286662:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286667:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286672:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286677:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286682:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286687:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286692:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286697:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286703:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286708:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286712:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286716:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286721:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286726:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286730:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286735:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286740:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286745:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286750:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286755:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286760:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286774:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286780:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286807:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286814:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286819:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286824:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286830:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286835:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286840:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286846:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286851:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286856:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286914:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286924:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286929:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286935:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286940:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286945:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286950:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286955:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286961:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286966:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286971:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286982:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286987:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286992:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.286998:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.287003:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.287009:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.287015:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.287575:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b6d06353a00:5870] 1 exiting: rc = 0 00000100:00100000:3.0:1787365015.289983:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b6d06351600:5871] 2 exiting: rc = 0 00000100:00100000:3.0:1787365015.291054:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b6d06351a00:5869] 0 exiting: rc = 1 00000100:00100000:3.0:1787365015.291140:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291149:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291171:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291176:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291182:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291188:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291193:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291198:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291206:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291211:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291217:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291223:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291229:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291235:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291241:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291248:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291273:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291280:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.291285:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292692:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292709:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292716:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292721:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292726:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292732:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292736:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292742:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292747:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292752:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292758:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292763:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292768:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292773:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292778:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292799:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292807:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292813:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292831:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292836:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292842:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292865:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292872:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292877:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292883:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292887:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292893:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292898:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292903:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292908:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292913:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292918:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292923:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292927:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292932:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292941:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292947:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292952:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292958:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292964:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292970:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292975:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292980:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292985:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365015.292990:0:12988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787365015.310156:0:12988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787365015.310170:0:12988:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787365015.310175:0:12988:0:(genops.c:885:class_export_put()) final put ffff9b6d02e63000/MDS_uuid 00000020:00000080:0.0:1787365015.310179:0:12988:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d02e63000/MDS_uuid for MDS 00000020:01000000:0.0:1787365015.310189:0:12988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787365015.310327:0:12988:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787365016.143381:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365017.163880:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787365017.687362:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787365017.687372:0:7661:0:(genops.c:885:class_export_put()) final put ffff9b6d0634b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787365017.687568:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d0634b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787365017.687622:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d0634a000 for lustre-OST0001 00010000:00010000:3.0:1787365018.186987:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365018.641392:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714127232:0@lo:400:kworker.0 00000400:00000100:1.0:1787365018.641454:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874187714127232 offset 0 length 224: 4 00000100:00100000:1.0:1787365018.641514:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365018.641520:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714127360:0@lo:400:kworker.0 00000400:00000100:1.0:1787365018.641542:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874187714127360 offset 0 length 224: 4 00000100:00100000:1.0:1787365018.641575:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714127488:0@lo:400:kworker.0 00000400:00000100:1.0:1787365018.641592:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874187714127488 offset 0 length 224: 4 00010000:00010000:1.0:1787365019.219034:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787365019.383611:0:13141:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787365019.397732:0:13141:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787365019.397813:0:13141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365019.397829:0:13141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365019.397837:0:13141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365019.397844:0:13141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365019.397868:0:13141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787365019.397874:0:13141:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787365019.397900:0:13141:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787365019.397912:0:13141:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d342d4e00 x1874187714127360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365019.397928:0:13141:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787365019.397934:0:13141:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787365019.397962:0:13141:0:(import.c:65:import_set_state_nolock()) ffff9b6c0491f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787365019.398380:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365019.398388:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365019.398397:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e35e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787365019.398401:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365019.398422:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365019.398430:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365019.398436:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787365019.398438:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787365019.398441:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787365019.398469:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365019.398489:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787365019.399127:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714127360:0@lo:400:kworker.0 00010000:00010000:3.0:1787365019.399976:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365019.399987:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d40e35e00/0xcfc9272e5fc2ae95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfc9272e5fc2ae9c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365019.400003:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365019.400005:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365019.400007:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365019.400019:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787365019.400038:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714127744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365019.400106:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365019.400167:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714127744 00000100:00100000:3.0:1787365019.400174:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714127744 00000100:00100000:3.0:1787365019.400237:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787365019.400245:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1874187714127744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787365019.400264:0:5842:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787365019 with bad export cookie 14972541516298496894 00000100:00100000:2.0:1787365019.401074:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874187714127616:0@lo:39:umount.0 00000400:00000100:2.0:1787365019.401109:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874187714127616 offset 0 length 224: 4 00000100:00100000:3.0:1787365019.423436:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1874187714127744:12345-0@lo:103:ldlm_bl.0 Request processed in 23181us (23319us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787365019.423452:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787365019.424326:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787365019.424332:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9b6d18df2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787365019.424337:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787365019.434377:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.102@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787365019.434383:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787365019.434394:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d342d6a00 x1874187714127232/t0(0) o400->MGC192.168.204.102@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787365034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365019.434590:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6c04b36300 x1874187714127744/t0(0) o103->MGC192.168.204.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787365035 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787365019.434602:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787365019.434605:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787365019.434606:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787365019.434611:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9b6d18df2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787365019.434616:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.204.102@tcp: connect to NID 0@lo last attempt 205 00000100:00080000:1.0:1787365019.434626:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.204.102@tcp: import ffff9b6d18df2000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:1.0:1787365019.434661:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d342d4e00 x1874187714127872/t0(0) o250->MGC192.168.204.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787365019.434702:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8853f36b-eb15-4321-aed5-724dfa11fdc2:3313:1874187714127744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365019.434862:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8853f36b-eb15-4321-aed5-724dfa11fdc2:3312:1874187714127872:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1787365019.434916:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874187714127872 offset 0 length 520: 4 00000100:00100000:2.0:1787365019.436202:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8853f36b-eb15-4321-aed5-724dfa11fdc2:3315:1874187714127232:0@lo:400:kworker.0 00000001:00100000:2.0:1787365019.722031:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787365019.722041:0:6733:0:(genops.c:885:class_export_put()) final put ffff9b6c0491d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787365019.722073:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c0491d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787365019.722126:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6c0491a800 for lustre-OST0000 00010000:00010000:1.0:1787365020.235873:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365021.261740:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365022.282942:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365023.307218:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787365023.754979:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787365023.754990:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787365023.755140:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787365023.755172:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714128000:0@lo:400:kworker.0 00000400:00000100:0.0:1787365023.755230:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874187714128000 offset 0 length 224: 4 00010000:00010000:1.0:1787365024.331119:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787365024.779850:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787365024.779860:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787365024.779978:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714128128:0@lo:400:kworker.0 00000400:00000100:0.0:1787365024.780033:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874187714128128 offset 0 length 224: 4 00010000:00010000:2.0:1787365025.358157:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365026.379462:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365027.404009:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365028.427929:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365029.452432:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787365029.899766:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787365029.899776:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787365029.899933:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365019/real 1787365019] req@ffff9b6d342d4e00 x1874187714127872/t0(0) o250->MGC192.168.204.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787365029 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365029.899959:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d342d4e00 x1874187714127872/t0(0) o250->MGC192.168.204.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787365029 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365029.899970:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365019/real 1787365019] req@ffff9b6c074ce680 x1874187714127616/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787365029 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365029.899982:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6c074ce680 x1874187714127616/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787365029 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787365029.899995:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d18df2000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787365029.900014:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787365029.900018:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8853f36b-eb15-4321-aed5-724dfa11fdc2:3312:1874187714127872:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1787365029.900033:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6c0491f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787365029.900042:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874187714127616:0@lo:39:umount.0 00000100:00080000:2.0:1787365029.900111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787365029.900115:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787365029.900118:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b6d18df2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787365029.900124:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.102@tcp: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1787365029.900129:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.102@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787365029.900136:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.102@tcp: import ffff9b6d18df2000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:2.0:1787365029.900154:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d40e18a80 x1874187714128384/t0(0) o250->MGC192.168.204.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787365029.900226:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8853f36b-eb15-4321-aed5-724dfa11fdc2:3312:1874187714128384:0@lo:250:kworker.0 00000400:00000100:3.0:1787365029.900271:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874187714128384 offset 0 length 520: 4 00000100:00100000:1.0:1787365029.900431:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714128256:0@lo:400:kworker.0 00000400:00000100:1.0:1787365029.900458:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874187714128256 offset 0 length 224: 4 00000100:00080000:0.0:1787365029.900843:0:13141:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787365029.900862:0:13141:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787365029.900867:0:13141:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787365029.906992:0:13141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365029.907912:0:13141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365029.907921:0:13141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365029.907927:0:13141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365029.907958:0:13141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365029.907965:0:13141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365029.907973:0:13141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365029.907980:0:13141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365029.907985:0:13141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365029.908095:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787365029.908117:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365029.908126:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40e34a00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787365029.908131:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365029.908140:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365029.908148:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365029.908154:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787365029.908156:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1787365029.908168:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d18df2000 00010000:00010000:3.0:1787365029.908173:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365029.908180:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34a00/0xcfc9272e5fc2aea3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2aeaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365029.908195:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365029.908198:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365029.908204:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0a00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:3.0:1787365029.908207:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365029.908213:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365029.908227:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365029.908233:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787365029.908236:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787365029.908242:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d18df2000 00010000:00010000:3.0:1787365029.908245:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365029.908254:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365029.908258:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365029.908260:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365029.908810:0:13141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787365029.908818:0:13141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2b0cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2b0d3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365029.908840:0:13141:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787365029.908845:0:13141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1787365029.908848:0:13141:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787365029.908880:0:13141:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787365029.908884:0:13141:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787365029.908890:0:13141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365029.908896:0:13141:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787365029.908901:0:13141:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b6d3ff599b8) has no exports 00000020:00080000:0.0:1787365029.908929:0:13141:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b6d3ff599b8) has no exports 00010000:00010000:1.0:1787365029.910139:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787365029.927213:0:13141:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6d40452420 - data ffff9b6d3bb8a1b0/ffff9b6c0621d800 00000020:01000000:0.0:1787365029.927384:0:13141:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6d187c3de0 - data ffff9b6c04d0c5e8/ffff9b6c052c5c00 00100000:10000000:0.0:1787365029.951466:0:13141:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787365030.004410:0:13141:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2acb2 00000020:00000080:2.0:1787365030.004421:0:13141:0:(genops.c:885:class_export_put()) final put ffff9b6c0501b800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787365030.004447:0:13141:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d055cd000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787365030.004451:0:13141:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6d055cd000 2 00000020:01000004:2.0:1787365030.004455:0:13141:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6d055cd000 from lustre-OST0000 00000020:00000080:2.0:1787365030.004498:0:13141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365030.004509:0:13141:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787365030.004512:0:13141:0:(genops.c:885:class_export_put()) final put ffff9b6c0501b000/lustre-OST0000_UUID 00000020:00000080:2.0:1787365030.004515:0:13141:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c0501b000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787365030.004523:0:13141:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787365030.004577:0:13141:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787365030.004582:0:13141:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787365030.004586:0:13141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365030.004591:0:13141:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787365030.004599:0:13141:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b6c0501e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787365030.004604:0:13141:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9b6d04f53370) has exports, disconnecting them 00000020:00080000:2.0:1787365030.004609:0:13141:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b6c0501e800), last request at 1787364778 00000020:00000080:2.0:1787365030.004613:0:13141:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2acdc 00000020:00080000:2.0:1787365030.004623:0:13141:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6c0501e800): rc 0 00000020:00000080:2.0:1787365030.004628:0:13141:0:(genops.c:885:class_export_put()) final put ffff9b6c0501e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787365030.004710:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c0501b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787365030.004721:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c0501e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787365030.005824:0:13141:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787365030.005831:0:13141:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787365030.005835:0:13141:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787365030.005841:0:13141:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787365030.005987:0:13141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365030.005992:0:13141:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787365030.005996:0:13141:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6d055cd000 1 00000020:00000080:2.0:1787365030.006001:0:13141:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ac6c 00000020:00000080:2.0:1787365030.006006:0:13141:0:(genops.c:885:class_export_put()) final put ffff9b6d2ffb3800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787365030.006011:0:13141:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787365030.006015:0:13141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365030.006018:0:13141:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787365030.006029:0:13141:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9b6d04f50000) has no exports 00000020:00000080:0.0:1787365030.006245:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6c0491f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787365030.006252:0:37:0:(genops.c:885:class_export_put()) final put ffff9b6c0491e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787365030.006254:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c0491e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787365030.006265:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787365030.006311:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d2ffb3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787365030.036496:0:13141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365030.036626:0:13141:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787365030.036631:0:13141:0:(genops.c:885:class_export_put()) final put ffff9b6d055c8000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787365030.036645:0:13141:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d055c8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787365030.036655:0:13141:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787365030.036814:0:13141:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b6d055cb800 00000020:02000400:2.0:1787365030.036861:0:13141:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787365030.475094:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365031.502100:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365032.525874:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365033.548112:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787365033.820586:0:13294:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787365033.830780:0:13294:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787365033.830892:0:13294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365033.830907:0:13294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365033.830916:0:13294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365033.830925:0:13294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365033.830939:0:13294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787365033.831115:0:13294:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787365033.831136:0:13294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787365033.831202:0:13294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d342d4380 x1874187714127488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365033.831223:0:13294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d40e1a300 x1874187714128000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365039 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365033.831240:0:13294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d342d4000 x1874187714128128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365033.831249:0:13294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d40e19180 x1874187714128256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365045 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365033.831258:0:13294:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787365033.831263:0:13294:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787365033.831290:0:13294:0:(import.c:65:import_set_state_nolock()) ffff9b6d06348800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787365033.831319:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874187714128512:0@lo:39:umount.0 00000100:00100000:0.0:1787365033.831336:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714128128:0@lo:400:kworker.0 00000100:00100000:0.0:1787365033.831348:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1874187714128000:0@lo:400:kworker.0 00000400:00000100:3.0:1787365033.831369:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874187714128512 offset 0 length 224: 4 00000100:00100000:2.0:1787365033.831941:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714128256:0@lo:400:kworker.0 00010000:00010000:1.0:1787365033.832241:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365033.832250:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365033.832260:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4800 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787365033.832264:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365033.832274:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365033.832282:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365033.832287:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787365033.832290:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787365033.832292:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787365033.832305:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d18df2000 00010000:00010000:1.0:1787365033.832309:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365033.832315:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4800/0xcfc9272e5fc2ae79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2ae80 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365033.832325:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365033.832327:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365033.832329:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365033.834130:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714127488:0@lo:400:kworker.0 00010000:00010000:2.0:1787365034.570969:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787365035.019684:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787365035.019698:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787365035.595261:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365036.619262:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365037.643142:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365038.667044:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365039.691124:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365040.139220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787365040.139234:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787365040.715160:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365041.739033:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365042.765419:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365043.084975:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365033/real 1787365033] req@ffff9b6c04b35880 x1874187714128512/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787365043 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365043.085047:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6c04b35880 x1874187714128512/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787365043 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787365043.085066:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d06348800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787365043.085089:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874187714128512:0@lo:39:umount.0 00000100:00080000:2.0:1787365043.085271:0:13294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787365043.085276:0:13294:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787365043.085281:0:13294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787365043.087271:0:13294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365043.087289:0:13294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365043.087296:0:13294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365043.087303:0:13294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365043.087381:0:13294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787365043.087390:0:13294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365043.087413:0:13294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365043.087419:0:13294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365043.087425:0:13294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365043.093634:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365043.093651:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365043.093664:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335600 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787365043.093669:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365043.093679:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365043.093685:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365043.093690:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787365043.093693:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787365043.093706:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d18df2000 00010000:00010000:1.0:1787365043.093710:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365043.093715:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d28335600/0xcfc9272e5fc2ae87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2ae8e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365043.093735:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365043.093740:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365043.093745:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787365043.093777:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365043.094004:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365043.094056:0:13294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1787365043.094066:0:13294:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787365043.094072:0:13294:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787365043.094102:0:13294:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787365043.094106:0:13294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787365043.094111:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365043.094117:0:13294:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787365043.094121:0:13294:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b6d3ff5b370) has no exports 00010000:00010000:1.0:1787365043.094400:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365043.094410:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365043.094415:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787365043.094417:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787365043.094419:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787365043.094427:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d18df2000 00010000:00010000:1.0:1787365043.094430:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365043.094437:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2b0be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2b0c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365043.094453:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365043.094455:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365043.094457:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787365043.094600:0:13294:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b6d3ff5b370) has no exports 00000020:01000000:2.0:1787365043.101345:0:13294:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6d40452780 - data ffff9b6d303275e8/ffff9b6d33d27000 00000020:01000000:2.0:1787365043.101479:0:13294:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6d40452300 - data ffff9b6d3b8e7a20/ffff9b6c05f99c00 00100000:10000000:2.0:1787365043.113325:0:13294:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787365043.189965:0:13294:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ad7d 00000020:00000080:0.0:1787365043.189977:0:13294:0:(genops.c:885:class_export_put()) final put ffff9b6d3550e000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787365043.189989:0:13294:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6c06f84800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787365043.189993:0:13294:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6c06f84800 2 00000020:01000004:0.0:1787365043.189996:0:13294:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6c06f84800 from lustre-OST0001 00000020:00000080:0.0:1787365043.190020:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787365043.190030:0:13294:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787365043.190033:0:13294:0:(genops.c:885:class_export_put()) final put ffff9b6d0634f800/lustre-OST0001_UUID 00000020:00000080:0.0:1787365043.190055:0:13294:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d0634f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787365043.190064:0:13294:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787365043.190220:0:13294:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8853f36b-eb15-4321-aed5-724dfa11fdc2->MGS 00010000:00010000:0.0:1787365043.190236:0:13294:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2ac96 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365043.190247:0:13294:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2ac96 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365043.190253:0:13294:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787365043.190256:0:13294:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787365043.190260:0:13294:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787365043.190275:0:13294:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d18df2000 00010000:00010000:0.0:1787365043.190279:0:13294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d28334a00/0xcfc9272e5fc2ac8f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2ac96 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365043.190296:0:13294:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfc9272e5fc2aed4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365043.190304:0:13294:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfc9272e5fc2aed4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365043.190310:0:13294:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787365043.190313:0:13294:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787365043.190315:0:13294:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787365043.190324:0:13294:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d18df2000 00010000:00010000:0.0:1787365043.190327:0:13294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d40e34400/0xcfc9272e5fc2aecd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfc9272e5fc2aed4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787365043.190344:0:13294:0:(import.c:65:import_set_state_nolock()) ffff9b6d18df2000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787365043.190348:0:13294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787365043.190357:0:13294:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787365043.190358:0:13294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787365043.190363:0:13294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787365043.190375:0:13294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d40e18a80 x1874187714128384/t0(0) o250->MGC192.168.204.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787365044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787365043.190391:0:13294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787365043.190394:0:13294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:2.0:1787365043.190466:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d3550e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1787365043.190697:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8853f36b-eb15-4321-aed5-724dfa11fdc2:3312:1874187714128384:0@lo:250:kworker.0 10000000:01000000:0.0:1787365043.190893:0:13294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787365043.190901:0:13294:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ab70 00000020:00000080:0.0:1787365043.190906:0:13294:0:(genops.c:885:class_export_put()) final put ffff9b6d02e67800/8853f36b-eb15-4321-aed5-724dfa11fdc2 00000020:01000000:0.0:1787365043.190914:0:13294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.102@tcp (flags='') 00000020:00000080:0.0:1787365043.190920:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365043.190924:0:13294:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787365043.190928:0:13294:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9b6d04f519b8) has no exports 00000020:00000080:2.0:1787365043.190978:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d02e67800/8853f36b-eb15-4321-aed5-724dfa11fdc2 for MGC192.168.204.102@tcp 10000000:01000000:3.0:1787365043.191021:0:5853:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787365043.191142:0:13294:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.102@tcp: client import never connected 00000100:00080000:0.0:1787365043.191145:0:13294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787365043.191148:0:13294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787365043.191150:0:13294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787365043.191152:0:13294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787365043.191192:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787365043.191197:0:13294:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.102@tcp (uuid 8853f36b-eb15-4321-aed5-724dfa11fdc2) 00000020:01000000:0.0:1787365043.191201:0:13294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787365043.191205:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365043.191208:0:13294:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787365043.191212:0:13294:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b6d0634e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787365043.191218:0:13294:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9b6d04f54d28) has exports, disconnecting them 00000020:00080000:0.0:1787365043.191222:0:13294:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b6d0634e800), last request at 1787364800 00000020:00000080:0.0:1787365043.191226:0:13294:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ada7 00000020:00080000:0.0:1787365043.191235:0:13294:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d0634e800): rc 0 00000020:00000080:0.0:1787365043.191238:0:13294:0:(genops.c:885:class_export_put()) final put ffff9b6d0634e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787365043.191660:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d18df2000 for MGC192.168.204.102@tcp 00000020:00000080:2.0:1787365043.191667:0:37:0:(genops.c:885:class_export_put()) final put ffff9b6d18df5800/8853f36b-eb15-4321-aed5-724dfa11fdc2 00000020:00000080:2.0:1787365043.191669:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d18df5800/8853f36b-eb15-4321-aed5-724dfa11fdc2 for MGC192.168.204.102@tcp 00000020:01000000:2.0:1787365043.191674:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.102@tcp (8853f36b-eb15-4321-aed5-724dfa11fdc2) 00000020:00000080:2.0:1787365043.191942:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d0634e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787365043.192477:0:13294:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787365043.192481:0:13294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787365043.192485:0:13294:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787365043.192490:0:13294:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787365043.192589:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787365043.192911:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1787365043.193065:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b6d075a8e00:5840] 1 exiting: rc = 0 00000100:00100000:3.0:1787365043.193157:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b6d081bf800:5839] 0 exiting: rc = 1 00000100:00100000:1.0:1787365043.193250:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.193493:0:12989:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b6d20000c00:12989] 3 exiting: rc = 0 00000100:00100000:1.0:1787365043.193547:0:5842:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b6d075a9600:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1787365043.196200:0:5841:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b6d075a9400:5841] 0 exiting: rc = 1 00000020:00000080:2.0:1787365043.196308:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6d06348800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1787365043.196515:0:5843:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b6d075a9000:5843] 2 exiting: rc = 0 00000100:00100000:1.0:1787365043.197045:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197064:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197070:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197079:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197084:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197090:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197096:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197152:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197159:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197165:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197170:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197176:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197182:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197188:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197194:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197200:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197205:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197210:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197215:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197220:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197225:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197231:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197237:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197241:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197246:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197251:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197257:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197262:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197267:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197272:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197277:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197282:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197287:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197292:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197298:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197302:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197317:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197321:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197326:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197331:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197336:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197340:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197345:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197350:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197355:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197360:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197364:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197369:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197374:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197378:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197383:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197389:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197394:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197398:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197403:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197408:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197415:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197419:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197424:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197429:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197434:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197439:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197444:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.197451:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787365043.198716:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365043.198728:0:13294:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787365043.198735:0:13294:0:(genops.c:885:class_export_put()) final put ffff9b6d06376000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787365043.198741:0:13294:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d06376000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787365043.198918:0:13294:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787365043.198967:0:13294:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6c06f84800 1 00000020:00000080:1.0:1787365043.198981:0:13294:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcfc9272e5fc2ad4c 00000020:00000080:1.0:1787365043.198989:0:13294:0:(genops.c:885:class_export_put()) final put ffff9b6d055b9000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787365043.199039:0:13294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787365043.199045:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365043.199050:0:13294:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787365043.199054:0:13294:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9b6d04fd99b8) has no exports 00000020:00000080:2.0:1787365043.205580:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d055b9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787365043.237392:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365043.237413:0:13294:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787365043.237421:0:13294:0:(genops.c:885:class_export_put()) final put ffff9b6c06f83000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787365043.237426:0:13294:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6c06f83000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787365043.237438:0:13294:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787365043.237643:0:13294:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b6c06f86000 00000020:01000000:2.0:1787365043.237680:0:13294:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787365043.237686:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365043.237691:0:13294:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787365043.237696:0:13294:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9b6d34484d28) has no exports 00000020:00000080:2.0:1787365043.237741:0:13294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365043.237748:0:13294:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787365043.237752:0:13294:0:(genops.c:885:class_export_put()) final put ffff9b6d2ffb6000/OSS_uuid 00000020:00000080:2.0:1787365043.237755:0:13294:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6d2ffb6000/OSS_uuid for OSS 00000020:01000000:2.0:1787365043.237778:0:13294:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787365043.237827:0:5852:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787365043.238042:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b6d3fb38a00:6707] 0 exiting: rc = 1 00000100:00100000:2.0:1787365043.238910:0:12088:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9b6d409be000:12088] 4 exiting: rc = 0 00000100:00100000:2.0:1787365043.240948:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b6d341eec00:6709] 1 exiting: rc = 0 00000100:00100000:1.0:1787365043.243198:0:8229:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b6d40c1dc00:8229] 3 exiting: rc = 0 00000100:00100000:1.0:1787365043.245021:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b6d3438c800:6710] 2 exiting: rc = 0 00000100:00100000:2.0:1787365043.245136:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245151:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245159:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245168:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245173:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245179:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245184:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245189:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245195:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245201:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245223:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245229:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245235:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245241:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245247:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245252:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245258:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245264:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245269:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245275:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245280:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245285:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245291:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245296:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245302:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245307:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245313:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245317:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245322:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245327:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.245333:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248468:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248502:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248508:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248514:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248519:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248524:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248530:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248535:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248540:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248545:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248551:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248555:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248560:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248579:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248599:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248605:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248610:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248615:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248620:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248625:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248630:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248635:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248640:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248645:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248651:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248659:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248665:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248853:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248866:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248874:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248879:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248884:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.248889:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.250079:0:8230:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9b6c053cdc00:8230] 2 exiting: rc = 0 00000100:00100000:0.0:1787365043.250478:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b6d3438cc00:6711] 0 exiting: rc = 1 00000100:00100000:3.0:1787365043.251364:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b6d3438da00:6712] 1 exiting: rc = 0 00000100:00100000:2.0:1787365043.251445:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251454:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251459:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251465:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251470:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251475:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251479:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251484:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251489:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251493:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251498:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251504:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251508:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251514:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251518:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251523:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251543:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251548:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251553:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.251559:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252287:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252300:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252305:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252311:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252317:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252322:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252327:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252332:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252337:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252342:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252347:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252353:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252358:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252363:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252368:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252400:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252406:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252411:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252417:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252422:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252428:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252433:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252438:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252443:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252448:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252453:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252458:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252462:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252466:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252471:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252476:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252490:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252495:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252499:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252503:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252508:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252513:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252518:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252523:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252528:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252533:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252538:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252543:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.252554:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.253681:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b6d33b42e00:6713] 0 exiting: rc = 1 00000100:00100000:1.0:1787365043.254247:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b6d3253f600:6714] 1 exiting: rc = 0 00000100:00100000:2.0:1787365043.257176:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b6d3438c200:6715] 2 exiting: rc = 0 00000100:00100000:0.0:1787365043.257418:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257428:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257434:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257439:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257445:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257452:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257457:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257462:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257468:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257556:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257565:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257573:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257578:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257584:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257590:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257594:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257599:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257605:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257611:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257616:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257622:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257628:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257633:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257640:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257645:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257650:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257655:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257660:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257665:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257670:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257675:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257689:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257697:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257730:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.257738:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258417:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258428:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258435:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258441:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258446:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258451:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258457:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258463:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258470:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.258477:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259195:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259203:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259209:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259215:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259221:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259227:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259232:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259238:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259245:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259251:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259258:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259263:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259270:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259276:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259282:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259288:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259293:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259313:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365043.259326:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365043.268196:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b6d0732c600:6717] 1 exiting: rc = 0 00000100:00100000:2.0:1787365043.268382:0:6932:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff9b6d073ebc00:6932] 2 exiting: rc = 0 00000100:00100000:0.0:1787365043.268942:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b6d3438ca00:6716] 0 exiting: rc = 1 00000100:00100000:2.0:1787365043.269003:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269011:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269017:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269022:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269028:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269033:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269037:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269043:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269048:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269053:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269059:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269064:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269070:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269075:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269079:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269084:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269088:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269093:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269099:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269115:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269132:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269142:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269147:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269152:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269156:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269161:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269166:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269178:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269184:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269190:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269195:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269201:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269205:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269211:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269216:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269222:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269227:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269233:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269239:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269245:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269250:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269255:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269260:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269265:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269270:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269275:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269280:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269285:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269290:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269295:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269301:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269305:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269310:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269316:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269321:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269335:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269341:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269347:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269352:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269357:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269363:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269368:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269373:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.269387:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365043.270322:0:6719:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b6d33d3fc00:6719] 1 exiting: rc = 0 00000100:00100000:0.0:1787365043.270422:0:6718:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b6d33d3f200:6718] 0 exiting: rc = 1 00000100:00100000:2.0:1787365043.270482:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270496:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270504:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270509:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270515:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270522:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270529:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270535:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270541:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270547:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270564:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270571:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270577:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270583:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270589:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270594:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270601:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270608:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270615:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270622:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270629:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270636:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270658:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270666:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270673:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270679:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270697:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270703:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270709:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270715:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270721:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270726:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270732:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270738:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270779:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270807:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270813:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270819:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270825:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270830:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270837:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270845:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270852:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270858:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270865:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270871:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270893:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270899:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270905:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270911:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270917:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270923:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270929:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270935:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270941:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270947:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270953:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270958:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270966:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270981:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.270988:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.271013:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.271036:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365043.271043:0:13294:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787365043.286499:0:13294:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787365064.245701:0:13910:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787365075.090263:0:14372:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787365075.090270:0:14372:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787365075.090390:0:14372:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b6c07201000 00000020:01000004:2.0:1787365075.090409:0:14372:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787365075.090417:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787365075.090432:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b6d04fd99b8) 00000020:00000080:2.0:1787365075.090449:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787365075.110405:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787365075.124709:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787365075.125760:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 533: rc = 0 00100000:10000000:3.0:1787365075.127186:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 533: rc = 0 00100000:10000000:3.0:1787365075.127328:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 533: rc = 0 00100000:10000000:3.0:1787365075.127525:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787365075.127601:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 533: rc = 0 00100000:10000000:3.0:1787365075.127701:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 533: rc = 0 00100000:10000000:3.0:1787365075.127823:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 533: rc = 0 00100000:10000000:3.0:1787365075.133797:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 535: rc = 0 00100000:10000000:3.0:1787365075.135046:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 152: rc = 0 00100000:10000000:3.0:1787365075.135160:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 152: rc = 0 00100000:10000000:3.0:1787365075.135577:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 157: rc = 0 00100000:10000000:3.0:1787365075.135933:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 157: rc = 0 00100000:10000000:3.0:1787365075.136218:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 157: rc = 0 00100000:10000000:3.0:1787365075.136456:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 157: rc = 0 00100000:10000000:3.0:1787365075.137616:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 157: rc = 0 00100000:10000000:3.0:1787365075.138050:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 157: rc = 0 00100000:10000000:3.0:1787365075.138335:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 157: rc = 0 00100000:10000000:3.0:1787365075.138587:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 157: rc = 0 00100000:10000000:3.0:1787365075.139189:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 157: rc = 0 00100000:10000000:3.0:1787365075.139439:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 157: rc = 0 00100000:10000000:3.0:1787365075.139691:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 157: rc = 0 00100000:10000000:3.0:1787365075.140243:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 157: rc = 0 00100000:10000000:3.0:1787365075.140686:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 605: rc = 0 00100000:10000000:2.0:1787365075.141346:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 605: rc = 0 00100000:10000000:2.0:1787365075.141597:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 605: rc = 0 00100000:10000000:2.0:1787365075.142039:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 605: rc = 0 00100000:10000000:2.0:1787365075.142324:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 605: rc = 0 00100000:10000000:2.0:1787365075.143372:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 605: rc = 0 00100000:10000000:2.0:1787365075.143709:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 605: rc = 0 00100000:10000000:2.0:1787365075.144227:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 605: rc = 0 00100000:10000000:2.0:1787365075.144555:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 605: rc = 0 00100000:10000000:2.0:1787365075.145716:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 605: rc = 0 00100000:10000000:2.0:1787365075.146182:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 605: rc = 0 00100000:10000000:2.0:1787365075.146411:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 605: rc = 0 00100000:10000000:2.0:1787365075.146667:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 605: rc = 0 00100000:10000000:2.0:1787365075.147036:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 605: rc = 0 00100000:10000000:2.0:1787365075.147286:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 605: rc = 0 00100000:10000000:2.0:1787365075.147598:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 605: rc = 0 00100000:10000000:2.0:1787365075.148009:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 605: rc = 0 00100000:10000000:2.0:1787365075.148269:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 605: rc = 0 00100000:10000000:2.0:1787365075.150731:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 605: rc = 0 00100000:10000000:2.0:1787365075.151187:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 605: rc = 0 00100000:10000000:2.0:1787365075.151489:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 605: rc = 0 00100000:10000000:2.0:1787365075.151765:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 605: rc = 0 00100000:10000000:2.0:1787365075.152263:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 605: rc = 0 00100000:10000000:2.0:1787365075.152504:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 605: rc = 0 00100000:10000000:2.0:1787365075.152749:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 605: rc = 0 00100000:10000000:2.0:1787365075.153282:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 605: rc = 0 00100000:10000000:2.0:1787365075.153533:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 605: rc = 0 00100000:10000000:2.0:1787365075.154187:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 605: rc = 0 00100000:10000000:2.0:1787365075.154442:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 605: rc = 0 00100000:10000000:2.0:1787365075.154680:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 605: rc = 0 00100000:10000000:2.0:1787365075.155016:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 605: rc = 0 00100000:10000000:2.0:1787365075.155268:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 605: rc = 0 00100000:10000000:2.0:1787365075.155681:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 171: rc = 0 00100000:10000000:2.0:1787365075.156404:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787365075.156561:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 153: rc = 0 00100000:10000000:2.0:1787365075.156736:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787365075.156877:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 153: rc = 0 00100000:10000000:2.0:1787365075.157067:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787365075.157130:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 153: rc = 0 00100000:10000000:2.0:1787365075.157527:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787365075.157592:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 155: rc = 0 00100000:10000000:2.0:1787365075.157779:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787365075.158061:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 155: rc = 0 00100000:10000000:2.0:1787365075.158260:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787365075.158327:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 155: rc = 0 00000020:00000080:2.0:1787365075.158603:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787365075.158618:0:14372:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787365075.158628:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2be71 00000020:01000004:2.0:1787365075.158638:0:14372:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787365075.158643:0:14372:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787365075.158648:0:14372:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6c07201000 from MGS 00000020:01000004:2.0:1787365075.158652:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787365075.158662:0:14372:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b6d04fdcd28) 00000020:00000080:2.0:1787365075.158674:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787365075.158730:0:14372:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6c07201000 from MGS, refs=2 00080000:01000000:2.0:1787365075.158736:0:14372:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787365075.158740:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2be7f 00000100:00100000:2.0:1787365075.159027:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787365075.161691:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787365075.161706:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787365075.162511:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787365075.162518:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787365075.163183:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365075.163360:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787365075.163365:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787365075.164108:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787365075.164115:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787365075.164413:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787365075.164420:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787365075.175261:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365075.175268:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365075.175270:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365075.180382:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365075.180389:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365075.180392:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365075.181042:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787365075.183824:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787365075.197636:0:14372:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787365075.197654:0:14372:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787365075.197657:0:14372:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787365075.205964:0:14381:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787365075.206346:0:14372:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787365075.206452:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787365075.207084:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787365075.207390:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787365075.207574:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787365075.207579:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787365075.209736:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787365075.209748:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787365075.210459:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787365075.210467:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787365075.214002:0:14386:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787365075.215126:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787365075.215160:0:14372:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.102@tcp' 00000020:01000004:0.0:1787365075.215163:0:14372:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787365075.215193:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.102@tcp (typ=mgc) 00000020:00000080:0.0:1787365075.215206:0:14372:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.102@tcp (ffff9b6d04f53370) 00000020:00000080:0.0:1787365075.215221:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787365075.215292:0:14372:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d02e67000@MGC192.168.204.102@tcp: add connection 192.168.204.102@tcp at head 00010000:00010000:0.0:1787365075.215445:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.102@tcp-0 is initialized 00000040:01000000:0.0:1787365075.215451:0:14372:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.102@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787365075.224282:0:14387:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787365075.224397:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.102@tcp (uuid 07eb110b-5671-42a1-88c0-bbf646942aa8) 00000020:00000080:2.0:1787365075.224428:0:14372:0:(genops.c:1385:class_connect()) connect: client 07eb110b-5671-42a1-88c0-bbf646942aa8, cookie 0xcfc9272e5fc2be8d 00000100:00080000:2.0:1787365075.224442:0:14372:0:(import.c:510:import_select_connection()) MGC192.168.204.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787365075.224458:0:14372:0:(import.c:624:import_select_connection()) MGC192.168.204.102@tcp: import ffff9b6d02e67000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:2.0:1787365075.224497:0:14372:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d40e1aa00 x1874187714128640/t0(0) o250->MGC192.168.204.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787365075.224543:0:14372:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 07eb110b-5671-42a1-88c0-bbf646942aa8->MGS 00000020:01000004:2.0:1787365075.224573:0:14372:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787365075.224579:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787365075.224597:0:14372:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b6d04fd8000) 00000020:00000080:2.0:1787365075.224619:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787365075.224773:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07eb110b-5671-42a1-88c0-bbf646942aa8:3312:1874187714128640:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787365075.224864:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365075.224935:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714128640 00000100:00100000:0.0:1787365075.224942:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714128640 00000100:00100000:0.0:1787365075.224971:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365075.224978:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1874187714128640:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787365075.225001:0:14383:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 07eb110b-5671-42a1-88c0-bbf646942aa8@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:0.0:1787365075.225023:0:14383:0:(genops.c:1385:class_connect()) connect: client 07eb110b-5671-42a1-88c0-bbf646942aa8, cookie 0xcfc9272e5fc2be9b 00000100:00080000:0.0:1787365075.225152:0:14383:0:(import.c:65:import_set_state_nolock()) ffff9b6d02e60000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787365075.225197:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+5:3312:x1874187714128640:12345-0@lo:250:mount.lustre.0 Request processed in 218us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.225205:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365075.225242:0:3312:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787365075.225249:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.102@tcp: connect to target with instance 0 00000100:00080000:0.0:1787365075.225265:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787365075.225269:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787365075.225273:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d02e67000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787365075.225275:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787365075.225282:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787365075.225287:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07eb110b-5671-42a1-88c0-bbf646942aa8:3312:1874187714128640:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787365075.260153:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787365075.260339:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787365075.260345:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787365075.277577:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787365075.277598:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787365075.286039:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787365075.286055:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787365075.286949:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787365075.287468:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787365075.287474:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787365075.288226:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787365075.288233:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787365075.363955:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787365075.364198:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787365075.364206:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787365075.366116:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787365075.366126:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787365075.366634:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787365075.366835:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787365075.366840:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787365075.367808:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787365075.367816:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787365075.368411:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365075.369416:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787365075.369424:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787365075.370257:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787365075.370264:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787365075.371072:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365075.371257:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787365075.371262:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787365075.371854:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787365075.371860:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787365075.394309:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787365075.396129:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787365075.396150:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787365075.400069:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787365075.400091:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787365075.405690:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787365075.405707:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787365075.407418:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787365075.407460:0:14372:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787365075.407466:0:14372:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787365075.407814:0:14372:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787365075.407854:0:14372:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.102@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787365075.407860:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787365075.407861:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365075.407867:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365075.407868:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365075.407869:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365075.407870:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365075.407871:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365075.407873:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365075.407875:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365075.407876:0:14372:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787365075.407879:0:14372:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787365075.407881:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787365075.407882:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365075.407882:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365075.407883:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365075.407884:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365075.407885:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365075.407886:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365075.407887:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365075.407888:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365075.407889:0:14372:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787365075.407917:0:14372:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787365075.407943:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714128768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787365075.408112:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.408232:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.408937:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714128768 00000100:00100000:0.0:1787365075.408945:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714128768 00000100:00100000:0.0:1787365075.409317:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365075.409328:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+5:14372:x1874187714128768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787365075.409393:0:14385:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787365075.409397:0:14385:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787365075.409400:0:14385:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787365075.410227:0:14406:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787365075.411763:0:14385:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787365075.413767:0:14407:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787365075.413774:0:14407:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787365075.413777:0:14407:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787365075.413944:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787365075.417319:0:14385:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787365075.417332:0:14385:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787365075.429394:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+5:14372:x1874187714128768:12345-0@lo:253:mount.lustre.0 Request processed in 20056us (21270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.429419:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365075.429678:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714128768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787365075.429694:0:14372:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787365075.429697:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787365075.429698:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365075.429700:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365075.429701:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365075.429702:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365075.429704:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365075.429705:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365075.429707:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365075.429708:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365075.429710:0:14372:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787365075.429730:0:14372:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6c07201000 from lustre-MDT0000 10000000:01000000:1.0:1787365075.429755:0:14372:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787365075.429764:0:14372:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787365075.429768:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b6d04f53370 10000000:01000000:1.0:1787365075.429773:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365075.429780:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d04f53370 from 1 10000000:01000000:1.0:1787365075.429906:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787365075.429951:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.430051:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.430063:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.430084:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714128896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365075.430200:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.430289:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b4be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365075.430334:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714128896 00000100:00100000:2.0:1787365075.430341:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714128896 00000100:00100000:2.0:1787365075.430571:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787365075.430580:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+5:14372:x1874187714128896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365075.430593:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365075.430608:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34448a00/0xcfc9272e5fc2bea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bea2 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.430631:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34448a00/0xcfc9272e5fc2bea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bea2 expref: 6 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.430642:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34448a00/0xcfc9272e5fc2bea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bea2 expref: 6 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.430651:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448a00, rc 0) 00000100:00100000:2.0:1787365075.430694:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+6:14372:x1874187714128896:12345-0@lo:101:mount.lustre.0 Request processed in 116us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365075.430700:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365075.430765:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714128896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365075.430807:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.430817:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.430874:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365075.430900:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.431128:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.431197:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714129024 00000100:00100000:0.0:1787365075.431202:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714129024 00000100:00100000:0.0:1787365075.431227:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365075.431233:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+6:14372:x1874187714129024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365075.431686:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+6:14372:x1874187714129024:12345-0@lo:501:mount.lustre.0 Request processed in 452us (784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787365075.431693:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365075.431947:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129024:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787365075.431989:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787365075.432016:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.432025:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365075.432035:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6c07201000 10000000:01000000:1.0:1787365075.432039:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787365075.432043:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b6c07201000 10000000:01000000:1.0:1787365075.432045:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787365075.432048:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b6c07201000 from 1 10000000:01000000:1.0:1787365075.432051:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787365075.432384:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2beb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.432414:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2beb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.432427:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2beb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.432644:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365075.432702:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.432766:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.432867:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714129152 00000100:00100000:0.0:1787365075.432873:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714129152 00000100:00100000:0.0:1787365075.432953:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365075.432978:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+6:14372:x1874187714129152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787365075.432989:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365075.433016:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40878400/0xcfc9272e5fc2beb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2beb0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.433060:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40878400/0xcfc9272e5fc2beb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2beb0 expref: 7 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.433072:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40878400/0xcfc9272e5fc2beb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2beb0 expref: 7 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.433104:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40878400, rc 0) 00000100:00100000:0.0:1787365075.433219:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+7:14372:x1874187714129152:12345-0@lo:101:mount.lustre.0 Request processed in 259us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.433226:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787365075.433640:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365075.433654:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2beb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2beb7 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.433663:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2beb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2beb7 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365075.433691:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787365075.433706:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2beb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2beb7 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.433713:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1600/0xcfc9272e5fc2beb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2beb7 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365075.433719:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787365075.433724:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365075.433729:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b6c07201000 10000000:01000000:1.0:1787365075.433731:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787365075.433735:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787365075.433737:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787365075.433756:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2bebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.433763:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2bebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.433770:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2bebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.433803:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365075.433835:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.433861:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.433923:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714129280 00000100:00100000:0.0:1787365075.433928:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714129280 00000100:00100000:0.0:1787365075.433950:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365075.433967:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+7:14372:x1874187714129280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787365075.433983:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365075.433993:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40878e00/0xcfc9272e5fc2bec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bebe expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.434009:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40878e00/0xcfc9272e5fc2bec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bebe expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.434017:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40878e00/0xcfc9272e5fc2bec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bebe expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.434024:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40878e00, rc 0) 00000100:00100000:0.0:1787365075.434061:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+8:14372:x1874187714129280:12345-0@lo:101:mount.lustre.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.434067:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365075.434245:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365075.434256:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2bebe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bec5 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.434273:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2bebe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bec5 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.434337:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365075.434363:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.434388:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.434937:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714129408 00000100:00100000:0.0:1787365075.434943:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714129408 00000100:00100000:0.0:1787365075.434981:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365075.434988:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+8:14372:x1874187714129408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365075.436747:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+9:14372:x1874187714129408:12345-0@lo:501:mount.lustre.0 Request processed in 1752us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.436760:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787365075.440367:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365075.440469:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365075.440556:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.440605:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d20b4be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365075.440846:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714129536 00000100:00100000:3.0:1787365075.440854:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714129536 00000100:00100000:3.0:1787365075.440919:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787365075.440928:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+9:14372:x1874187714129536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365075.442368:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+9:14372:x1874187714129536:12345-0@lo:503:mount.lustre.0 Request processed in 1431us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365075.442382:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787365075.443627:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714129536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787365075.448909:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e18e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14408:1874187714129664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365075.449011:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365075.449064:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02c1b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.449381:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714129664 00000100:00100000:0.0:1787365075.449388:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714129664 00000100:00100000:0.0:1787365075.449439:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787365075.449460:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+9:14408:x1874187714129664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365075.451836:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e18e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14408:1874187714129664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787365075.451895:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365075.451909:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365075.451912:0:14408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787365075.451917:0:14408:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787365075.451921:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787365075.451939:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b6d04fdb370) 00000020:00000080:2.0:1787365075.451994:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787365075.452027:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787365075.453373:0:14408:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787365075.453385:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2bed3 00000100:00100000:0.0:1787365075.453676:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+9:14408:x1874187714129664:12345-0@lo:502:llog_process_th.0 Request processed in 4225us (4661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.453704:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00000080:2.0:1787365075.456286:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787365075.456303:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365075.456315:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365075.456318:0:14408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787365075.456322:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365075.456329:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365075.456330:0:14408:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787365075.456335:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787365075.456377:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b6d3f9ccd28) 00000020:00000080:2.0:1787365075.456400:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787365075.456406:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787365075.456408:0:14408:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787365075.456411:0:14408:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787365075.456417:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787365075.458095:0:14408:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6c07201000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787365075.458131:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b6d34483370) 00000020:00000080:3.0:1787365075.458155:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787365075.458247:0:14408:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787365075.458253:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2bee8 00000020:00000080:3.0:1787365075.458386:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787365075.458393:0:14408:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787365075.458397:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcfc9272e5fc2beef 00080000:01000000:3.0:1787365075.458404:0:14408:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787365075.458408:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2bef6 00010000:00010000:3.0:1787365075.589477:0:14408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787365075.596971:0:14408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787365075.597366:0:14408:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787365075.598089:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b6d34480000) 00000020:00000080:3.0:1787365075.598109:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787365075.598236:0:14408:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787365075.598243:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2bf04 00000020:00000080:3.0:1787365075.604478:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787365075.619703:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcfc9272e5fc2bf0b 00000020:00000080:1.0:1787365075.629349:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787365075.629365:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365075.629374:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.629376:0:14408:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787365075.629379:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365075.629386:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.629388:0:14408:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787365075.629392:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787365075.629441:0:14408:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787365075.629459:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365075.629462:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.629464:0:14408:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787365075.629466:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787365075.629468:0:14408:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1787365075.629470:0:14408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787365075.629472:0:14408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787365075.629484:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787365075.629487:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.629488:0:14408:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787365075.629491:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787365075.629494:0:14408:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787365075.629497:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.629498:0:14408:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787365075.629501:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787365075.629506:0:14408:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.102@tcp to nid 0x20000c0a8cc66 (192.168.204.102@tcp) 00000020:01000000:1.0:1787365075.629548:0:14408:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787365075.629551:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787365075.629568:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b6d3ff5b370) 00000020:00000080:1.0:1787365075.629585:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787365075.629591:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787365075.629653:0:14408:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787365075.629659:0:14408:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787365075.629667:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2bf19 00010000:00080000:1.0:1787365075.629702:0:14408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6c07207000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.102@tcp at head 00010000:00010000:1.0:1787365075.629940:0:14408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787365075.630366:0:14408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787365075.630413:0:14408:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787365075.631385:0:14408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787365075.631444:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787365075.631516:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787365075.634273:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787365075.634284:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787365075.645367:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787365075.645390:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787365075.645436:0:14408:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787365075.645458:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2bf20 00000100:00080000:3.0:1787365075.645470:0:14408:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787365075.645477:0:14408:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6c07207000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:3.0:1787365075.645583:0:14408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c04b35880 x1874187714129792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787365075.645661:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714129792:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787365075.645736:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874187714129792 offset 0 length 520: 4 00000100:00080000:3.0:1787365075.645851:0:14408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787365075.645913:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365075.645917:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.645919:0:14408:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787365075.645922:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787365075.645924:0:14408:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787365075.645926:0:14408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787365075.645927:0:14408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787365075.645929:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787365075.645932:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.645933:0:14408:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787365075.645935:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787365075.645939:0:14408:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787365075.645942:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.645949:0:14408:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787365075.645967:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787365075.645971:0:14408:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.102@tcp to nid 0x20000c0a8cc66 (192.168.204.102@tcp) 00000020:01000000:3.0:1787365075.645993:0:14408:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787365075.645996:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787365075.646010:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b6d34484d28) 00000020:00000080:3.0:1787365075.646022:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787365075.646026:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787365075.646098:0:14408:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787365075.646105:0:14408:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787365075.646345:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfc9272e5fc2bf2e 00010000:00080000:3.0:1787365075.646378:0:14408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d10986000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.102@tcp at head 00010000:00010000:3.0:1787365075.646657:0:14408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787365075.648392:0:14408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787365075.648417:0:14408:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787365075.650767:0:14408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365075.651829:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787365075.651924:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787365075.652895:0:14414:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787365075.652901:0:14414:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787365075.653985:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787365075.653999:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787365075.654031:0:14408:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787365075.654050:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2bf35 00000100:00080000:1.0:1787365075.654062:0:14408:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787365075.654074:0:14408:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d10986000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:1.0:1787365075.654216:0:14408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d342d7b80 x1874187714129920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787365075.654244:0:14408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787365075.654303:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365075.654307:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.654309:0:14408:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787365075.654312:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365075.654316:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.654318:0:14408:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787365075.654320:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787365075.654322:0:14408:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787365075.654324:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365075.654327:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.654328:0:14408:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787365075.654330:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365075.654333:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.654334:0:14408:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787365075.654337:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787365075.654371:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14408:1874187714130048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365075.654444:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365075.654570:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714129920:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787365075.654599:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874187714129920 offset 0 length 520: 4 00000100:00100000:3.0:1787365075.654687:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714130048 00000100:00100000:3.0:1787365075.654694:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714130048 00000100:00100000:3.0:1787365075.654734:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787365075.654743:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+9:14408:x1874187714130048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365075.655006:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+9:14408:x1874187714130048:12345-0@lo:502:llog_process_th.0 Request processed in 263us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365075.655013:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787365075.655191:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0133a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365075.655217:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14408:1874187714130048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365075.655243:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365075.655248:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365075.655250:0:14408:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787365075.655253:0:14408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787365075.658320:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787365075.658359:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787365075.658443:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2bebe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bec5 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.658458:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1400/0xcfc9272e5fc2bebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bec5 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365075.658467:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6c07201000 from 1 10000000:01000000:2.0:1787365075.658497:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787365075.658542:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.658551:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.658561:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365075.658585:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787365075.658652:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365075.658703:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365075.659280:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714130176 00000100:00100000:1.0:1787365075.659288:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714130176 00000100:00100000:1.0:1787365075.659339:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787365075.659349:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+9:14372:x1874187714130176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365075.659371:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365075.659385:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bf3c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.659406:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.659416:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.659424:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0800, rc 0) 00000100:00100000:1.0:1787365075.659466:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+10:14372:x1874187714130176:12345-0@lo:101:mount.lustre.0 Request processed in 119us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365075.659474:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787365075.662185:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365075.662221:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.662236:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365075.662874:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130304:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787365075.662950:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365075.662995:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365075.663270:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714130304 00000100:00100000:1.0:1787365075.663277:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714130304 00000100:00100000:1.0:1787365075.663322:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787365075.663330:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+10:14372:x1874187714130304:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787365075.663349:0:14384:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787365075.663355:0:14384:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787365075.663430:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+10:14372:x1874187714130304:12345-0@lo:256:mount.lustre.0 Request processed in 100us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365075.663437:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365075.663517:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130304:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787365075.664119:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787365075.666756:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365075.666774:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365075.667603:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6c07201000 from 1 10000000:01000000:1.0:1787365075.667608:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365075.667656:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.667666:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.667683:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.667708:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365075.667771:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.667839:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0133a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365075.668717:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714130432 00000100:00100000:2.0:1787365075.668726:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714130432 00000100:00100000:2.0:1787365075.668809:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787365075.668820:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+10:14372:x1874187714130432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365075.668838:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365075.668863:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bf4a expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.668889:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 11 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.668900:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 11 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365075.668909:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448400, rc 0) 00000100:00100000:2.0:1787365075.668973:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14372:x1874187714130432:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365075.668981:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787365075.669184:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365075.669202:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.669210:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.669280:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365075.669308:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.669329:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0133a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365075.669657:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714130560 00000100:00100000:2.0:1787365075.669662:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714130560 00000100:00100000:2.0:1787365075.669695:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787365075.669702:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14372:x1874187714130560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365075.670248:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14372:x1874187714130560:12345-0@lo:501:mount.lustre.0 Request processed in 545us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365075.670256:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787365075.670352:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365075.670390:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365075.670432:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.670454:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0133a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365075.670560:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714130688 00000100:00100000:3.0:1787365075.670566:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714130688 00000100:00100000:3.0:1787365075.670601:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787365075.670608:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14372:x1874187714130688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365075.670760:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14372:x1874187714130688:12345-0@lo:503:mount.lustre.0 Request processed in 152us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365075.670766:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787365075.670879:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714130688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365075.677596:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14416:1874187714130816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365075.677698:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365075.677745:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26480 going to sleep for 11 seconds 00000100:00100000:2.0:1787365075.677822:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714130816 00000100:00100000:2.0:1787365075.677829:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714130816 00000100:00100000:2.0:1787365075.677878:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365075.677888:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14416:x1874187714130816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365075.678384:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14416:x1874187714130816:12345-0@lo:502:llog_process_th.0 Request processed in 496us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365075.678393:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787365075.678566:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14416:1874187714130816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787365075.678598:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365075.678609:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.678612:0:14416:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787365075.678619:0:14416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6c07201000 00000020:00000080:3.0:1787365075.678622:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787365075.678631:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365075.678635:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.678636:0:14416:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787365075.678638:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365075.678641:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.678643:0:14416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787365075.678646:0:14416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6c07201000 00000020:00000080:3.0:1787365075.678648:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787365075.678763:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365075.678767:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.678769:0:14416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787365075.678777:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365075.678781:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.678813:0:14416:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787365075.678818:0:14416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6c07201000 00000020:00000080:3.0:1787365075.678820:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787365075.690557:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14416:1874187714130944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365075.690639:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365075.690689:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26480 going to sleep for 11 seconds 00000100:00100000:1.0:1787365075.693425:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714130944 00000100:00100000:1.0:1787365075.693439:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714130944 00000100:00100000:1.0:1787365075.693566:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787365075.693577:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14416:x1874187714130944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365075.694174:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14416:x1874187714130944:12345-0@lo:502:llog_process_th.0 Request processed in 597us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365075.694183:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787365075.694405:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14416:1874187714130944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787365075.694441:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365075.695346:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365075.695348:0:14416:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787365075.695354:0:14416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787365075.695593:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787365075.695620:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787365075.695678:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.695691:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365075.695733:0:14372:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787365075.695736:0:14372:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6c07201000 10000000:01000000:1.0:1787365075.695739:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6c07201000 10000000:01000000:1.0:1787365075.695744:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365075.695750:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6c07201000 from 1 10000000:01000000:1.0:1787365075.695753:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787365075.695819:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2bf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.695828:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2bf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.695839:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2bf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.695862:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714131072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365075.695932:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.695971:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06268780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.697426:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714131072 00000100:00100000:0.0:1787365075.697437:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714131072 00000100:00100000:0.0:1787365075.697514:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787365075.697524:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14372:x1874187714131072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787365075.697540:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365075.697561:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40879000/0xcfc9272e5fc2bf5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bf58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.697589:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40879000/0xcfc9272e5fc2bf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf58 expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.697601:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40879000/0xcfc9272e5fc2bf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf58 expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.697610:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879000, rc 0) 00000100:00100000:0.0:1787365075.698567:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14372:x1874187714131072:12345-0@lo:101:mount.lustre.0 Request processed in 1042us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.698576:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787365075.698650:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714131072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787365075.698670:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2bf58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf5f expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.698680:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2bf58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bf5f expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365075.698756:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714131200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365075.699530:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365075.699567:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d061c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.699600:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714131200 00000100:00100000:0.0:1787365075.699607:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714131200 00000100:00100000:0.0:1787365075.699640:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787365075.699648:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14372:x1874187714131200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365075.700671:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14372:x1874187714131200:12345-0@lo:501:mount.lustre.0 Request processed in 1019us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.700680:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787365075.700738:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714131200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365075.701145:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714131328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365075.701193:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365075.701221:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d061c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.701238:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714131328 00000100:00100000:0.0:1787365075.701244:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714131328 00000100:00100000:0.0:1787365075.701277:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787365075.701285:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14372:x1874187714131328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365075.701440:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14372:x1874187714131328:12345-0@lo:503:mount.lustre.0 Request processed in 154us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.701919:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787365075.701967:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714131328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365075.705310:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14421:1874187714131456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365075.705403:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365075.705456:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26840 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.705557:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714131456 00000100:00100000:0.0:1787365075.705569:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714131456 00000100:00100000:0.0:1787365075.705656:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787365075.705666:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14421:x1874187714131456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365075.705941:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14421:x1874187714131456:12345-0@lo:502:llog_process_th.0 Request processed in 275us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.705950:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787365075.706108:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14421:1874187714131456:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787365075.706186:0:14421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787365075.706201:0:14421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b6d344819b8) 00000020:00000080:3.0:1787365075.706218:0:14421:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787365075.706294:0:14421:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6c07201000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787365075.706298:0:14421:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6c07201000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787365075.706301:0:14421:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6c07201000 4 00010000:00080000:3.0:1787365075.706329:0:14421:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d03506800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.102@tcp at head 00010000:00010000:3.0:1787365075.708900:0:14421:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787365075.709455:0:14421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787365075.709556:0:14421:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787365075.709570:0:14421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcfc9272e5fc2bf6d 00000100:00080000:3.0:1787365075.709588:0:14421:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787365075.709595:0:14421:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b6d03506800 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:3.0:1787365075.709631:0:14421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c04b36a00 x1874187714131584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787365075.709661:0:14421:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787365075.709833:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714131584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787365075.709904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.709976:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714131584 00000100:00100000:1.0:1787365075.709984:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714131584 00000100:00100000:1.0:1787365075.710013:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365075.710021:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874187714131584:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787365075.710545:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874187714131584:12345-0@lo:38:llog_process_th.0 Request processed in 521us (639us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787365075.710554:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365075.710593:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787365075.710601:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d03506800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365075.710605:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787365075.710609:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714131584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787365075.711418:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14421:1874187714131712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365075.711606:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365075.711677:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365075.711710:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714131712 00000100:00100000:1.0:1787365075.711715:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714131712 00000100:00100000:1.0:1787365075.711755:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787365075.711764:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14421:x1874187714131712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365075.714064:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14421:x1874187714131712:12345-0@lo:502:llog_process_th.0 Request processed in 2182us (2466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365075.714079:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787365075.714274:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07eb110b-5671-42a1-88c0-bbf646942aa8:14421:1874187714131712:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787365075.714308:0:14421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787365075.714449:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787365075.714467:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787365075.714551:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2bf58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf5f expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.714562:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0a00/0xcfc9272e5fc2bf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf5f expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787365075.714699:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787365075.714701:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365075.714703:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365075.714704:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365075.714706:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365075.714707:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365075.714711:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365075.714712:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365075.714714:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365075.714715:0:14372:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787365075.714719:0:14372:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787365075.714721:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787365075.714723:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365075.714724:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365075.714725:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365075.714729:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365075.714730:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365075.714731:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365075.714732:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365075.714733:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365075.714734:0:14372:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787365075.714758:0:14372:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787365075.714779:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714131840:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787365075.714855:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365075.714893:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d06268900 going to sleep for 11 seconds 00000100:00100000:0.0:1787365075.715273:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714131840 00000100:00100000:0.0:1787365075.715279:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714131840 00000100:00100000:0.0:1787365075.715353:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787365075.715363:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14372:x1874187714131840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787365075.715390:0:14384:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787365075.715404:0:14384:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787365075.793674:0:14384:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787365075.793695:0:14384:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787365075.795239:0:14406:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787365075.795249:0:14406:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787365075.795271:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.795289:0:14406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.795299:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.795341:0:14406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.795356:0:14406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 12 pid: 14383 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365075.795372:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1874187714131968:0@lo:104: 00000100:00100000:0.0:1787365075.795459:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365075.795506:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d061c1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365075.795850:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714131968 00000100:00100000:1.0:1787365075.795859:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714131968 00000100:00100000:1.0:1787365075.795911:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365075.795920:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07eb110b-5671-42a1-88c0-bbf646942aa8+3:14406:x1874187714131968:12345-0@lo:104: 00010000:00010000:1.0:1787365075.795935:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.796028:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787365075.796035:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07eb110b-5671-42a1-88c0-bbf646942aa8+3:14406:x1874187714131968:12345-0@lo:104: Request processed in 117us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365075.796042:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787365075.796065:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365075.796071:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.796079:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449600 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:1.0:1787365075.796083:0:14379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.796091:0:14379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365075.796099:0:14379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365075.796105:0:14379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787365075.796379:0:14379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.796387:0:14379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365075.796406:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.796413:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d34449600/0xcfc9272e5fc2bf3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365075.796445:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365075.796447:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365075.796449:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365075.796479:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365075.796490:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb110b-5671-42a1-88c0-bbf646942aa8:3313:1874187714132096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365075.796531:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365075.796944:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714132096 00000100:00100000:0.0:1787365075.796950:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714132096 00010000:00010000:0.0:1787365075.796982:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 13 pid: 14383 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365075.797011:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365075.797020:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07eb110b-5671-42a1-88c0-bbf646942aa8+13:3313:x1874187714132096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365075.797030:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365075.797035:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 13 pid: 14383 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797046:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 13 pid: 14383 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797067:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797076:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787365075.797093:0:14375:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001844813s 00010000:00010000:0.0:1787365075.797099:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797266:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797276:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797295:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797302:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365075.797306:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797315:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797324:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797334:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365075.797380:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07eb110b-5671-42a1-88c0-bbf646942aa8+13:3313:x1874187714132096:12345-0@lo:103:ldlm_bl.0 Request processed in 361us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365075.797387:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787365075.797493:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0800/0xcfc9272e5fc2bf43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf3c expref: 12 pid: 14383 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365075.797505:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1874187714131968:0@lo:104: 00010000:00010000:0.0:1787365075.797522:0:14406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797530:0:14406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797536:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365075.797553:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40878800/0xcfc9272e5fc2bf74 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365075.798521:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb110b-5671-42a1-88c0-bbf646942aa8:3313:1874187714132096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365075.808934:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14372:x1874187714131840:12345-0@lo:253:mount.lustre.0 Request processed in 93561us (94067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365075.808950:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787365075.809468:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:14372:1874187714131840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787365075.809489:0:14372:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787365075.809493:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787365075.809495:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787365075.809496:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365075.809498:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787365075.809499:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365075.809500:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365075.809502:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787365075.809504:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787365075.809506:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365075.809507:0:14372:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787365075.809533:0:14372:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787365075.825666:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365075.825876:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365075.826187:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365075.826346:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365075.826635:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365075.826826:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787365075.831575:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365075.831737:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787365075.832298:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365075.832542:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787365075.832896:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365075.833073:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787365075.934671:0:14372:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787365075.939201:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787365075.939672:0:14429:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787365075.939678:0:14429:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787365075.939837:0:14430:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787365075.939975:0:14430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365075.944840:0:14430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787365075.944921:0:14430:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787365075.944926:0:14430:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787365075.946930:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787365075.947051:0:14372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787365075.951346:0:14372:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787365075.951519:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787365075.951874:0:14372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365075.953498:0:14372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787365075.954215:0:14372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787365075.954256:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787365075.962097:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787365075.979253:0:14372:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787365076.062191:0:14372:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787365076.062231:0:14372:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb71e018a3988 00100000:10000000:1.0:1787365076.062241:0:14372:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787365076.063428:0:14372:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787365076.063444:0:14372:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787365076.063464:0:14372:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787365076.063491:0:14372:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787365076.235065:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787365076.491071:0:14387:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787365076.491079:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6c07201000 from 6 10000000:01000000:1.0:1787365076.491084:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787365076.491158:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365076.491170:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365076.491183:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365076.491208:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714132224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365076.491277:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365076.491365:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02ed1300 going to sleep for 11 seconds 00000100:00100000:0.0:1787365076.495085:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714132224 00000100:00100000:0.0:1787365076.495100:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714132224 00000100:00100000:2.0:1787365076.495406:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787365076.495419:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14387:x1874187714132224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365076.495439:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365076.495471:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bf7b expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365076.495514:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365076.495527:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365076.495537:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448800, rc 0) 00000100:00100000:2.0:1787365076.495633:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14387:x1874187714132224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365076.495640:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787365076.495809:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714132224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365076.495828:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365076.495838:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365076.495907:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714132352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787365076.495951:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365076.508006:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714132352 00000100:00100000:1.0:1787365076.508024:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714132352 00000100:00100000:1.0:1787365076.508093:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787365076.508104:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14387:x1874187714132352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787365076.508140:0:14383:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787365076.508166:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787365076.508170:0:14383:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787365076.517337:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f26d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365076.519314:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14387:x1874187714132352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 11200us (23351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365076.519330:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787365076.521289:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714132352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787365076.522291:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787365076.522303:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365076.522315:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365076.754291:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787365077.259255:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787365077.771590:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787365078.283982:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365079.307083:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365080.331108:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787365080.825575:0:14673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787365081.100864:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1787365081.100900:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365081.100905:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787365081.100908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365081.100911:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787365081.100914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787365081.100917:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787365081.100921:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b6d03506800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787365081.100934:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b6d03506800 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:2.0:1787365081.100966:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d40e19180 x1874187714132608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787365081.102516:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714132608:0@lo:38:kworker.0 00000100:00100000:1.0:1787365081.102673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365081.103280:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714132608 00000100:00100000:2.0:1787365081.103290:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714132608 00000100:00100000:2.0:1787365081.103329:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365081.103337:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1874187714132608:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787365081.103376:0:14392:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:2.0:1787365081.103414:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcfc9272e5fc2bf89 00000004:00100000:2.0:1787365081.103429:0:14392:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787365081.103596:0:14392:0:(import.c:65:import_set_state_nolock()) ffff9b6d2056f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365081.103659:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874187714132608:12345-0@lo:38:kworker.0 Request processed in 321us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365081.103667:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787365081.104201:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6d40e19180 x1874187714132608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787365081.104219:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787365081.104226:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787365081.104232:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787365081.104234:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d03506800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787365081.104240:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874187714132608:0@lo:38:kworker.0 00000100:00100000:0.0:1787365081.104775:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb110b-5671-42a1-88c0-bbf646942aa8:3316:1874187714132480:0@lo:400:kworker.0 00000100:00100000:0.0:1787365081.105207:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365081.105302:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714132480 00000100:00100000:2.0:1787365081.105309:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714132480 00000100:00100000:2.0:1787365081.105392:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787365081.105402:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:3316:x1874187714132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365081.105462:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:3316:x1874187714132480:12345-0@lo:400:kworker.0 Request processed in 62us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365081.105470:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787365081.106249:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb110b-5671-42a1-88c0-bbf646942aa8:3316:1874187714132480:0@lo:400:kworker.0 00010000:00010000:1.0:1787365081.356430:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365082.388132:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365083.403012:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787365084.198196:0:14824:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff15c0d660 20000000:00000080:0.0:1787365084.198216:0:14824:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d1180a800 uarg=0000000000000000 20000000:01000000:0.0:1787365084.198254:0:14824:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787365084.198262:0:14824:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787365084.198267:0:14824:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787365084.199126:0:14825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787365084.199276:0:14824:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787365084.205612:0:14824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787365084.205646:0:14824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.205682:0:14824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 11 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.205692:0:14824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.205741:0:14824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 11 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.205758:0:14824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 11 pid: 14385 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365084.205774:0:14824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14824:1874187714132736:0@lo:104: 00000100:00100000:0.0:1787365084.206084:0:14824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365084.206151:0:14824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365084.206230:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714132736 00000100:00100000:1.0:1787365084.206239:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714132736 00000100:00100000:1.0:1787365084.206299:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365084.206311:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+3:14824:x1874187714132736:12345-0@lo:104: 00010000:00010000:1.0:1787365084.206326:0:14374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365084.206388:0:14374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787365084.206394:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+3:14824:x1874187714132736:12345-0@lo:104: Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365084.206401:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365084.206538:0:14824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14824:1874187714132736:0@lo:104: 00010000:00010000:0.0:1787365084.206564:0:14824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207034:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365084.207042:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207050:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0200 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787365084.207054:0:14378:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207062:0:14378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365084.207083:0:14378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365084.207088:0:14378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365084.207127:0:14378:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207133:0:14378:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365084.207165:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207172:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0200/0xcfc9272e5fc2bf4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf51 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207189:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365084.207190:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365084.207192:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365084.207279:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb110b-5671-42a1-88c0-bbf646942aa8:3316:1874187714132864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787365084.207328:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365084.207619:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714132864 00000100:00100000:0.0:1787365084.207624:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714132864 00010000:00010000:0.0:1787365084.207650:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 12 pid: 14385 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365084.207686:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365084.207695:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:3316:x1874187714132864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365084.207707:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365084.207713:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 12 pid: 14385 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207723:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 12 pid: 14385 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207745:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2bf51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf4a expref: 12 pid: 14385 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207759:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207767:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207781:0:14376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207805:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207812:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207818:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207823:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365084.207828:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207835:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207848:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207867:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365084.207900:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+11:3316:x1874187714132864:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365084.207907:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787365084.207931:0:14824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.207939:0:14824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365084.208073:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40878600/0xcfc9272e5fc2bf90 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365084.209149:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb110b-5671-42a1-88c0-bbf646942aa8:3316:1874187714132864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365084.427136:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365085.199083:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365075/real 1787365075] req@ffff9b6d342d7b80 x1874187714129920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365085 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365085.199171:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d342d7b80 x1874187714129920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365085 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365085.199184:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365075/real 1787365075] req@ffff9b6c04b35880 x1874187714129792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365085 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365085.199202:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6c04b35880 x1874187714129792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365085 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787365085.199233:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365085.199284:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787365085.199289:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714129920:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787365085.199296:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6c07207000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365085.199302:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787365085.199305:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714129792:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787365085.200309:0:14335:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365085.200315:0:14335:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787365085.200318:0:14335:0:(import.c:65:import_set_state_nolock()) ffff9b6c07207000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787365085.200325:0:14335:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1787365085.200332:0:14335:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787365085.200340:0:14335:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6c07207000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:3.0:1787365085.200366:0:14335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c04b37800 x1874187714133120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787365085.200381:0:14335:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365085.200384:0:14335:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787365085.200386:0:14335:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787365085.200388:0:14335:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1787365085.200391:0:14335:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787365085.200394:0:14335:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d10986000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:3.0:1787365085.200403:0:14335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c04b35c00 x1874187714133248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787365085.200455:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714133376:0@lo:400:kworker.0 00000100:00100000:3.0:1787365085.200552:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365085.200622:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365085.200628:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07eb110b-5671-42a1-88c0-bbf646942aa8:3314:1874187714132992:0@lo:400:kworker.0 00000100:00100000:3.0:1787365085.200662:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365085.200727:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714133376 00000100:00100000:3.0:1787365085.200736:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714133376 00000100:00100000:3.0:1787365085.200810:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365085.200819:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714133376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365085.200897:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714133376:12345-0@lo:400:kworker.0 Request processed in 78us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365085.200905:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365085.200933:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714132992 00000100:00100000:3.0:1787365085.200936:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714132992 00000100:00100000:3.0:1787365085.200981:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365085.200987:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+11:3314:x1874187714132992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365085.201017:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+11:3314:x1874187714132992:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365085.201022:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365085.201069:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07eb110b-5671-42a1-88c0-bbf646942aa8:3314:1874187714132992:0@lo:400:kworker.0 00010000:00080000:3.0:1787365085.201082:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6c04b35880 x1874187714133376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365085.201092:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714133376:0@lo:400:kworker.0 00000100:00100000:3.0:1787365085.201119:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714133120:0@lo:8:kworker.0 00000400:00000100:3.0:1787365085.201145:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874187714133120 offset 0 length 520: 4 00000100:00100000:3.0:1787365085.201160:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714133248:0@lo:8:kworker.0 00000400:00000100:3.0:1787365085.201179:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874187714133248 offset 0 length 520: 4 00010000:00010000:0.0:1787365085.452105:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787365086.026988:0:14387:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787365086.026997:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6c07201000 from 10 10000000:01000000:1.0:1787365086.027003:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365086.027058:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.027071:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.027083:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365086.027109:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714133504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365086.027198:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365086.027343:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.031513:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714133504 00000100:00100000:2.0:1787365086.031531:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714133504 00000100:00100000:2.0:1787365086.031663:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787365086.031675:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+11:14387:x1874187714133504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365086.031692:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365086.031711:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bf97 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.031738:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.031762:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.031771:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448c00, rc 0) 00000100:00100000:2.0:1787365086.032134:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14387:x1874187714133504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 460us (4934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.032141:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787365086.035334:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714133504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365086.035364:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.035379:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365086.035463:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714133632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365086.035524:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365086.035569:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.035606:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714133632 00000100:00100000:3.0:1787365086.035615:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714133632 00000100:00100000:3.0:1787365086.035666:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787365086.035677:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14387:x1874187714133632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365086.036152:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14387:x1874187714133632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 477us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.036171:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787365086.037596:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714133632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365086.037658:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714133760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365086.037722:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365086.038098:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.038141:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714133760 00000100:00100000:2.0:1787365086.038147:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714133760 00000100:00100000:2.0:1787365086.038230:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787365086.038247:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14387:x1874187714133760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365086.038479:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:14387:x1874187714133760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.038487:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787365086.038572:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714133760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787365086.040060:0:14885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787365086.040288:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787365086.040319:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787365086.040330:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.040341:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.474971:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365087.501148:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787365088.018540:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787365088.528973:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365089.552599:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787365089.953099:0:15072:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787365089.953104:0:15072:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787365089.953244:0:15072:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b6d02d4f800 00000020:01000004:2.0:1787365089.953273:0:15072:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787365089.953287:0:15072:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787365089.953302:0:15072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b6d3f9c99b8) 00000020:00000080:2.0:1787365089.953317:0:15072:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787365089.999386:0:15072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787365090.000211:0:15072:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787365090.003769:0:15072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787365090.007050:0:15072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787365090.007670:0:15072:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787365090.009088:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 511: rc = 0 00100000:10000000:2.0:1787365090.009191:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 511: rc = 0 00100000:10000000:2.0:1787365090.009290:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 511: rc = 0 00100000:10000000:0.0:1787365090.013499:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 553: rc = 0 00100000:10000000:0.0:1787365090.014201:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 553: rc = 0 00100000:10000000:0.0:1787365090.014447:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 553: rc = 0 00100000:10000000:0.0:1787365090.017533:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 553: rc = 0 00100000:10000000:0.0:1787365090.017838:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 553: rc = 0 00100000:10000000:0.0:1787365090.018118:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 553: rc = 0 00000020:00000080:0.0:1787365090.018701:0:15072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787365090.018712:0:15072:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787365090.018722:0:15072:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcfc9272e5fc2bfac 00000020:01000004:0.0:1787365090.018729:0:15072:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787365090.018751:0:15072:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.102@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787365090.018755:0:15072:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787365090.018761:0:15072:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787365090.018766:0:15072:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787365090.018777:0:15072:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b6d04f54d28) 00000020:00000080:0.0:1787365090.018817:0:15072:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787365090.023780:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365090.027739:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787365090.027746:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787365090.032446:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787365090.032461:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787365090.035054:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787365090.035067:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787365090.040025:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365090.040214:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787365090.040220:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787365090.044457:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787365090.044470:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787365090.085361:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365090.086650:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787365090.086659:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787365090.088406:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787365090.088418:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787365090.089743:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787365090.089754:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787365090.097646:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787365090.097908:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787365090.097923:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787365090.099390:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787365090.099402:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787365090.133969:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787365090.134257:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787365090.134264:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787365090.135309:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787365090.135319:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787365090.135981:0:15072:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787365090.136007:0:15072:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787365090.136014:0:15072:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787365090.145447:0:15072:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787365090.145497:0:15072:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.102@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787365090.145501:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787365090.145503:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787365090.145504:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365090.145505:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365090.145507:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365090.145508:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365090.145509:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365090.145512:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365090.145513:0:15072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787365090.145517:0:15072:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787365090.145524:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787365090.145525:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787365090.145526:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365090.145527:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365090.145528:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365090.145529:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365090.145530:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365090.145531:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365090.145532:0:15072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787365090.145563:0:15072:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787365090.145586:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714133888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787365090.145661:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365090.145823:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365090.145959:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714133888 00000100:00100000:0.0:1787365090.145968:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714133888 00000100:00100000:0.0:1787365090.146063:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787365090.146072:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:15072:x1874187714133888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787365090.146114:0:14384:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787365090.146116:0:14384:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787365090.146125:0:14384:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787365090.167042:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:15072:x1874187714133888:12345-0@lo:253:mount.lustre.0 Request processed in 20962us (21372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365090.167056:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787365090.167205:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714133888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787365090.167222:0:15072:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787365090.167225:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787365090.167227:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787365090.167228:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365090.167229:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365090.167231:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365090.167232:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365090.167234:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365090.167236:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365090.167237:0:15072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787365090.167258:0:15072:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d02d4f800 from lustre-OST0000 10000000:01000000:3.0:1787365090.167288:0:15072:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787365090.167291:0:15072:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787365090.167298:0:15072:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6d04f53370 local copy 00010000:00010000:3.0:1787365090.167308:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365090.167545:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365090.167580:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365090.167623:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12600 going to sleep for 11 seconds 00000100:00100000:2.0:1787365090.167693:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714134016 00000100:00100000:2.0:1787365090.167699:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714134016 00000100:00100000:2.0:1787365090.167743:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787365090.167754:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:15072:x1874187714134016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365090.168167:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+12:15072:x1874187714134016:12345-0@lo:501:mount.lustre.0 Request processed in 415us (585us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787365090.168176:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787365090.168243:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134016:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787365090.168258:0:15072:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787365090.168406:0:15072:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787365090.168413:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.168423:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365090.168445:0:15072:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d02d4f800 10000000:01000000:3.0:1787365090.168449:0:15072:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787365090.168454:0:15072:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b6d04f53370 10000000:01000000:3.0:1787365090.168456:0:15072:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787365090.168460:0:15072:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b6d04f53370 from 1 10000000:01000000:3.0:1787365090.168463:0:15072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787365090.168491:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2bfba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.168499:0:15072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2bfba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.168508:0:15072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2bfba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365090.168522:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787365090.168550:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365090.168581:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12600 going to sleep for 11 seconds 00000100:00100000:0.0:1787365090.169248:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714134144 00000100:00100000:0.0:1787365090.169256:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714134144 00000100:00100000:0.0:1787365090.169308:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787365090.169318:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+12:15072:x1874187714134144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787365090.169333:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365090.169352:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40879800/0xcfc9272e5fc2bfc1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bfba expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.169379:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40879800/0xcfc9272e5fc2bfc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bfba expref: 13 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.169391:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40879800/0xcfc9272e5fc2bfc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bfba expref: 13 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.169400:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40879800, rc 0) 00000100:00100000:0.0:1787365090.169454:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+13:15072:x1874187714134144:12345-0@lo:101:mount.lustre.0 Request processed in 138us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365090.169461:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787365090.169588:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365090.169603:0:15072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2bfba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfc1 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.169624:0:15072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2bfba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bfc1 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365090.169647:0:15072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787365090.169661:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2bfba lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfc1 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.169669:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9000/0xcfc9272e5fc2bfba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfc1 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365090.169676:0:15072:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787365090.169680:0:15072:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787365090.169685:0:15072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787365090.169687:0:15072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787365090.169705:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2bfc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.169713:0:15072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2bfc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.169720:0:15072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2bfc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365090.169735:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787365090.169766:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365090.169980:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12600 going to sleep for 11 seconds 00000100:00100000:2.0:1787365090.170059:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714134272 00000100:00100000:2.0:1787365090.170065:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714134272 00000100:00100000:2.0:1787365090.170101:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787365090.170109:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+13:15072:x1874187714134272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365090.170118:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365090.170130:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34448000/0xcfc9272e5fc2bfcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bfc8 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.170147:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34448000/0xcfc9272e5fc2bfcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bfc8 expref: 14 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.170154:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34448000/0xcfc9272e5fc2bfcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bfc8 expref: 14 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.170161:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448000, rc 0) 00000100:00100000:2.0:1787365090.170193:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134272:12345-0@lo:101:mount.lustre.0 Request processed in 84us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365090.170199:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787365090.170374:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365090.170387:0:15072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2bfc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfcf expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.170403:0:15072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2bfc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bfcf expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787365090.172335:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787365090.173481:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787365090.173726:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787365090.173771:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787365090.173923:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787365090.173978:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787365090.174031:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787365090.174067:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787365090.174134:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787365090.174142:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787365090.174224:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365090.174295:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365090.174348:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365090.174433:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714134400 00000100:00100000:1.0:1787365090.174441:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714134400 00000100:00100000:1.0:1787365090.174506:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787365090.174515:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365090.175039:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134400:12345-0@lo:501:mount.lustre.0 Request processed in 523us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.175056:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787365090.175347:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365090.175464:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365090.175512:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.175584:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d099f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365090.175626:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714134528 00000100:00100000:0.0:1787365090.175631:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714134528 00000100:00100000:0.0:1787365090.175704:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787365090.175713:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365090.176309:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134528:12345-0@lo:503:mount.lustre.0 Request processed in 596us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365090.176323:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787365090.176572:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134528:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787365090.177986:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787365090.178080:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365090.178151:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365090.178234:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d07827f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365090.178288:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714134656 00000100:00100000:3.0:1787365090.178295:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714134656 00000100:00100000:3.0:1787365090.178389:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787365090.178400:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365090.178684:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134656:12345-0@lo:502:mount.lustre.0 Request processed in 285us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365090.178692:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787365090.178815:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787365090.179186:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787365090.179238:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787365090.179272:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787365090.179319:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787365090.179358:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787365090.179393:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787365090.179441:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787365090.179472:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787365090.179504:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787365090.179550:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787365090.179588:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787365090.179654:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787365090.179690:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365090.179739:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365090.179771:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d07827f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365090.179940:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714134784 00000100:00100000:0.0:1787365090.179947:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714134784 00000100:00100000:0.0:1787365090.179988:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787365090.179996:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787365090.180379:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134784:12345-0@lo:502:mount.lustre.0 Request processed in 383us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365090.180387:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787365090.180461:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787365090.180537:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787365090.180546:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787365090.181586:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787365090.181595:0:15086:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787365090.181601:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365090.181603:0:15086:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787365090.181610:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787365090.181626:0:15086:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b6d04f519b8) 00000020:00000080:0.0:1787365090.181650:0:15086:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787365090.181656:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787365090.181729:0:15086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d02d4f800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787365090.181737:0:15086:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787365090.181743:0:15086:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcfc9272e5fc2bfdd 00010000:00010000:1.0:1787365090.185477:0:15086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787365090.185995:0:15086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787365090.187880:0:15086:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787365090.189234:0:15086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787365090.189245:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365090.189250:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365090.189253:0:15086:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787365090.189256:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787365090.189259:0:15086:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787365090.189260:0:15086:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787365090.189268:0:15086:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787365090.189269:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787365090.189272:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365090.189273:0:15086:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787365090.189276:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365090.189279:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365090.189280:0:15086:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787365090.189282:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787365090.189284:0:15086:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787365090.189286:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365090.189288:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365090.189289:0:15086:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787365090.189291:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365090.189293:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365090.189294:0:15086:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787365090.189297:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787365090.189348:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365090.189351:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365090.189352:0:15086:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787365090.189355:0:15086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787365090.189501:0:15072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787365090.189527:0:15072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787365090.189550:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2bfc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfcf expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.189563:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9c00/0xcfc9272e5fc2bfc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfcf expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365090.189571:0:15072:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d02d4f800 from 1 10000000:01000000:1.0:1787365090.189574:0:15072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365090.189612:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.189620:0:15072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.189631:0:15072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365090.189653:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365090.189722:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.189774:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714134912 00000100:00100000:1.0:1787365090.189781:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714134912 00000100:00100000:1.0:1787365090.189915:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787365090.189924:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+14:15072:x1874187714134912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365090.189938:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365090.189949:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bfe4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.189973:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.189983:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.189991:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1800, rc 0) 00000100:00100000:1.0:1787365090.190023:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714134912:12345-0@lo:101:mount.lustre.0 Request processed in 101us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.190029:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787365090.190072:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02ed1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787365090.190092:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714134912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365090.190106:0:15072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.190114:0:15072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787365090.190544:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787365090.192554:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787365090.193012:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787365090.193070:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787365090.193129:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787365090.193138:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787365090.193226:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365090.193295:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.193344:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02ed1300 going to sleep for 11 seconds 00000100:00100000:0.0:1787365090.193710:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714135040 00000100:00100000:0.0:1787365090.193719:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714135040 00000100:00100000:0.0:1787365090.193770:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787365090.193780:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365090.194126:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135040:12345-0@lo:501:mount.lustre.0 Request processed in 345us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365090.194134:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787365090.194336:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365090.194374:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365090.194412:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.194446:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02ed1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787365090.194492:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714135168 00000100:00100000:3.0:1787365090.194497:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714135168 00000100:00100000:3.0:1787365090.194532:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787365090.194547:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365090.194695:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135168:12345-0@lo:503:mount.lustre.0 Request processed in 150us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365090.194702:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787365090.194770:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787365090.195397:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365090.195473:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365090.195519:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.195959:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c05f86180 going to sleep for 11 seconds 00000100:00100000:3.0:1787365090.198042:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714135296 00000100:00100000:3.0:1787365090.198055:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714135296 00000100:00100000:1.0:1787365090.198187:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787365090.198198:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365090.198456:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135296:12345-0@lo:502:mount.lustre.0 Request processed in 260us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.198465:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787365090.198531:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365090.198921:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787365090.198975:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787365090.199026:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787365090.199061:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787365090.199106:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787365090.199152:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787365090.199188:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787365090.199222:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787365090.199262:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365090.199313:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.199349:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714135424 00000100:00100000:1.0:1787365090.199354:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714135424 00000100:00100000:1.0:1787365090.199377:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787365090.199384:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365090.199521:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135424:12345-0@lo:502:mount.lustre.0 Request processed in 136us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.199528:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787365090.199571:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c05f86180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365090.199585:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365090.199658:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787365090.199668:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787365090.203777:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365090.204026:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365090.204034:0:15090:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787365090.204044:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d02d4f800 00000020:00000080:0.0:1787365090.204047:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787365090.204054:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365090.204057:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365090.204058:0:15090:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787365090.204061:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365090.204063:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365090.204065:0:15090:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787365090.204068:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d02d4f800 00000020:00000080:0.0:1787365090.204069:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787365090.204161:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365090.204165:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365090.204167:0:15090:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787365090.204169:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365090.204172:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365090.204173:0:15090:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787365090.204176:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d02d4f800 00000020:00000080:0.0:1787365090.204178:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787365090.205039:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365090.205047:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365090.205048:0:15090:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787365090.205052:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787365090.209810:0:15072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787365090.210012:0:15072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787365090.210041:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.210056:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365090.210136:0:15072:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787365090.210139:0:15072:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d02d4f800 10000000:01000000:2.0:1787365090.210143:0:15072:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d02d4f800 10000000:01000000:2.0:1787365090.210147:0:15072:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787365090.210153:0:15072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d02d4f800 from 1 10000000:01000000:2.0:1787365090.210155:0:15072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787365090.210203:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d34449e00/0xcfc9272e5fc2bff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.210212:0:15072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d34449e00/0xcfc9272e5fc2bff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.210224:0:15072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d34449e00/0xcfc9272e5fc2bff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365090.210250:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787365090.210319:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365090.210361:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d07827900 going to sleep for 11 seconds 00000100:00100000:1.0:1787365090.210521:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714135552 00000100:00100000:1.0:1787365090.210529:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714135552 00000100:00100000:1.0:1787365090.210620:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787365090.210631:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714135552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365090.210646:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365090.210663:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2bff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2bff2 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.210689:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2bff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bff2 expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.210717:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c1200/0xcfc9272e5fc2bff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bff2 expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.210727:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1200, rc 0) 00000100:00100000:1.0:1787365090.210837:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714135552:12345-0@lo:101:mount.lustre.0 Request processed in 200us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.210852:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787365090.212098:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365090.212120:0:15072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d34449e00/0xcfc9272e5fc2bff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bff9 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.212132:0:15072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d34449e00/0xcfc9272e5fc2bff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2bff9 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365090.212702:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787365090.217181:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365090.217499:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787365090.217545:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787365090.217580:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787365090.217622:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787365090.217658:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787365090.217721:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787365090.217761:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787365090.217861:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787365090.217931:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787365090.217979:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787365090.218012:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787365090.218062:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787365090.218098:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787365090.218131:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787365090.218178:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787365090.218216:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787365090.218249:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787365090.218295:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787365090.218332:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787365090.218365:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787365090.222395:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787365090.222459:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787365090.222495:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787365090.222570:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787365090.222608:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787365090.222641:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787365090.222689:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787365090.222724:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787365090.222939:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787365090.222948:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787365090.223074:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365090.223160:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365090.223206:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d07827900 going to sleep for 11 seconds 00000100:00100000:1.0:1787365090.224976:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714135680 00000100:00100000:1.0:1787365090.224989:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714135680 00000100:00100000:1.0:1787365090.225056:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787365090.225067:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714135680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365090.225405:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714135680:12345-0@lo:501:mount.lustre.0 Request processed in 338us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.225414:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787365090.225486:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365090.225552:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365090.225608:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.225645:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c05f86e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365090.225664:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714135808 00000100:00100000:1.0:1787365090.225669:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714135808 00000100:00100000:1.0:1787365090.225696:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787365090.225703:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714135808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365090.228111:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714135808:12345-0@lo:503:mount.lustre.0 Request processed in 2400us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.228125:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787365090.228208:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135808:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787365090.230071:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365090.230164:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365090.230238:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.230325:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c05f86e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365090.235964:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714135936 00000100:00100000:3.0:1787365090.235977:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714135936 00000100:00100000:3.0:1787365090.236967:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787365090.236983:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714135936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365090.237332:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714135936:12345-0@lo:502:mount.lustre.0 Request processed in 354us (7093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365090.237341:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787365090.242566:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714135936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365090.242947:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787365090.243003:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787365090.243031:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787365090.243069:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787365090.243098:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787365090.243151:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787365090.243184:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787365090.243215:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787365090.243259:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787365090.243287:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787365090.243314:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787365090.243350:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787365090.243399:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787365090.243427:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787365090.243466:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787365090.243494:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787365090.243521:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787365090.243557:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787365090.243584:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787365090.243611:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787365090.243647:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787365090.243675:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787365090.243702:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787365090.243740:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787365090.243781:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787365090.244521:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787365090.244582:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787365090.244612:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787365090.244657:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787365090.244697:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787365090.244727:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787365090.244754:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787365090.244780:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787365090.245012:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787365090.245042:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787365090.245099:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787365090.245141:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787365090.245177:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787365090.245225:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787365090.245263:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787365090.245319:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714136064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365090.245413:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.245515:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6c05f86e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365090.245558:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714136064 00000100:00100000:3.0:1787365090.245565:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714136064 00000100:00100000:3.0:1787365090.245649:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787365090.245660:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714136064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365090.246033:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714136064:12345-0@lo:502:mount.lustre.0 Request processed in 375us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365090.246041:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787365090.246337:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714136064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787365090.246427:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787365090.246440:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787365090.247697:0:15095:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787365090.247712:0:15095:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b6d04f50000) 00000020:00000080:0.0:1787365090.247733:0:15095:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787365090.248015:0:15095:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d02d4f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787365090.248020:0:15095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d02d4f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787365090.248023:0:15095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6d02d4f800 3 00010000:00080000:0.0:1787365090.248061:0:15095:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d0fdd8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.102@tcp at head 00010000:00010000:0.0:1787365090.250247:0:15095:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787365090.250541:0:15095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787365090.250583:0:15095:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787365090.250595:0:15095:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcfc9272e5fc2c007 00000100:00080000:0.0:1787365090.250605:0:15095:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787365090.250612:0:15095:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b6d0fdd8000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:0.0:1787365090.250653:0:15095:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c074cea00 x1874187714136192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787365090.250682:0:15095:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787365090.250760:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787365090.250765:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787365090.250767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787365090.250770:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787365090.250969:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714136320:0@lo:400:kworker.0 00000100:00100000:0.0:1787365090.251043:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365090.251145:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874187714136192:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787365090.251179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.251267:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714136320 00000100:00100000:1.0:1787365090.251275:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714136320 00000100:00100000:1.0:1787365090.251319:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714136192 00000100:00100000:1.0:1787365090.251323:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714136192 00000100:00100000:1.0:1787365090.251337:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365090.251346:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714136320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365090.251422:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874187714136320:12345-0@lo:400:kworker.0 Request processed in 78us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.251430:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365090.251447:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365090.251452:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874187714136192:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787365090.251472:0:14390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1787365090.251504:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcfc9272e5fc2c00e 00000004:00100000:1.0:1787365090.251518:0:14390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787365090.251549:0:14390:0:(import.c:65:import_set_state_nolock()) ffff9b6c052dd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365090.251590:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874187714136192:12345-0@lo:38:llog_process_th.0 Request processed in 136us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.251597:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787365090.251634:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6c074cea00 x1874187714136192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365090.251644:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787365090.251652:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787365090.251659:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787365090.251663:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787365090.251665:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d0fdd8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787365090.251671:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1874187714136192:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787365090.251737:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6d342d4e00 x1874187714136320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365090.251747:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874187714136320:0@lo:400:kworker.0 00000040:00080000:0.0:1787365090.252235:0:15095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787365090.252391:0:15072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787365090.252422:0:15072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787365090.252446:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d34449e00/0xcfc9272e5fc2bff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bff9 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.252472:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d34449e00/0xcfc9272e5fc2bff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bff9 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787365090.252515:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787365090.252517:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787365090.252518:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365090.252519:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365090.252521:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365090.252522:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365090.252523:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365090.252526:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365090.252527:0:15072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787365090.252531:0:15072:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787365090.252533:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787365090.252534:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787365090.252536:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365090.252537:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365090.252537:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365090.252539:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365090.252540:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365090.252541:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365090.252542:0:15072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787365090.252561:0:15072:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787365090.252579:0:15072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714136448:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787365090.252627:0:15072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365090.252664:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714136448 00000100:00100000:3.0:1787365090.252669:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714136448 00000100:00100000:3.0:1787365090.252701:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787365090.252709:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15072:x1874187714136448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787365090.252746:0:14385:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787365090.252760:0:14385:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787365090.253263:0:15072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d33e12300 going to sleep for 11 seconds 20000000:01000000:2.0:1787365090.285688:0:14385:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787365090.285705:0:14385:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787365090.285727:0:14406:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787365090.285732:0:14406:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787365090.285754:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.285774:0:14406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 16 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.285816:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.285969:0:14406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 16 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365090.285985:0:14406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 16 pid: 14385 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365090.286002:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1874187714136576:0@lo:104: 00000100:00100000:2.0:1787365090.286067:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365090.286114:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d07827cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365090.286443:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714136576 00000100:00100000:3.0:1787365090.286463:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714136576 00000100:00100000:3.0:1787365090.286523:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365090.286533:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+3:14406:x1874187714136576:12345-0@lo:104: 00010000:00010000:3.0:1787365090.286551:0:14374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365090.286618:0:14374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787365090.286623:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+3:14406:x1874187714136576:12345-0@lo:104: Request processed in 93us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365090.286632:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787365090.286936:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1874187714136576:0@lo:104: 00010000:00010000:2.0:1787365090.286962:0:14406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.287888:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365090.287900:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.287911:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787365090.287916:0:14379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.287925:0:14379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365090.287932:0:14379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365090.287950:0:14379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787365090.288000:0:14379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288006:0:14379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365090.288033:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288040:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1c00/0xcfc9272e5fc2bf7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf82 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288057:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365090.288059:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365090.288060:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365090.288077:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb110b-5671-42a1-88c0-bbf646942aa8:3316:1874187714136704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365090.288136:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365090.288398:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714136704 00000100:00100000:0.0:1787365090.288404:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714136704 00010000:00010000:0.0:1787365090.288430:0:14377:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 17 pid: 14385 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365090.288462:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787365090.288570:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07eb110b-5671-42a1-88c0-bbf646942aa8+17:3316:x1874187714136704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365090.288590:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365090.288597:0:14377:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 17 pid: 14385 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288610:0:14377:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 17 pid: 14385 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288636:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d34448800/0xcfc9272e5fc2bf82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf7b expref: 17 pid: 14385 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288653:0:14377:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288661:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787365090.288690:0:14377:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002958989s 00010000:00010000:0.0:1787365090.288695:0:14377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288703:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288710:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288716:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288721:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449000 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365090.288725:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.288733:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.293606:0:14406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365090.293627:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.293724:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.293742:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c015 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365090.294138:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365090.294235:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3316:x1874187714136704:12345-0@lo:103:ldlm_bl.0 Request processed in 5761us (6094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365090.294247:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365090.294390:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb110b-5671-42a1-88c0-bbf646942aa8:3316:1874187714136704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365090.297038:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+15:15072:x1874187714136448:12345-0@lo:253:mount.lustre.0 Request processed in 44320us (44401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365090.297054:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787365090.297144:0:15072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15072:1874187714136448:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787365090.297161:0:15072:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787365090.297164:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787365090.297166:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787365090.297167:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365090.297168:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365090.297169:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365090.297170:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365090.297172:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365090.297174:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365090.297175:0:15072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787365090.297189:0:15072:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787365090.303211:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365090.303394:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365090.303863:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365090.304029:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365090.304163:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365090.304362:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787365090.305758:0:15072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787365090.430594:0:15072:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787365090.430606:0:15072:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787365090.430646:0:15072:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787365090.430711:0:15072:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787365090.430725:0:15072:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787365090.430759:0:15072:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787365090.571565:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365091.609859:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787365092.172001:0:14387:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787365092.172010:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6c07201000 from 7 10000000:01000000:1.0:1787365092.172016:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787365092.172067:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365092.172093:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365092.172105:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365092.172333:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714136832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365092.172405:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365092.172471:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40e37480 going to sleep for 11 seconds 00000100:00100000:3.0:1787365092.172492:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714136832 00000100:00100000:3.0:1787365092.172507:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714136832 00000100:00100000:3.0:1787365092.172597:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787365092.172610:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+15:14387:x1874187714136832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365092.172632:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365092.172662:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2c01c expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365092.172699:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 16 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365092.172729:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 16 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365092.172741:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c9800, rc 0) 00000100:00100000:3.0:1787365092.174235:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:14387:x1874187714136832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1622us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365092.174247:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787365092.175067:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714136832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365092.175100:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365092.175111:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365092.175201:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714136960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787365092.175263:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365092.175320:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d10909540 going to sleep for 11 seconds 00000100:00100000:3.0:1787365092.176534:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714136960 00000100:00100000:3.0:1787365092.176551:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714136960 00000100:00100000:3.0:1787365092.176627:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787365092.176638:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:14387:x1874187714136960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787365092.176671:0:14385:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787365092.176696:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787365092.176699:0:14385:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787365092.177052:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:14387:x1874187714136960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 414us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365092.177062:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787365092.179971:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714136960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787365092.180082:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787365092.180093:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365092.180104:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365092.619165:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365093.645146:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365094.667105:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365095.437346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365095.437362:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787365095.437365:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365095.437369:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787365095.437384:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb110b-5671-42a1-88c0-bbf646942aa8:3313:1874187714137088:0@lo:400:kworker.0 00000100:00100000:3.0:1787365095.437426:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714137216:0@lo:400:kworker.0 00000100:00100000:1.0:1787365095.437701:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365095.437719:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714137344:0@lo:400:kworker.0 00000100:00100000:3.0:1787365095.439068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365095.441138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365095.441517:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714137088 00000100:00100000:3.0:1787365095.441531:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714137088 00000100:00100000:3.0:1787365095.441592:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787365095.441603:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3313:x1874187714137088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365095.441726:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3313:x1874187714137088:12345-0@lo:400:kworker.0 Request processed in 118us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365095.441734:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787365095.441835:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb110b-5671-42a1-88c0-bbf646942aa8:3313:1874187714137088:0@lo:400:kworker.0 00000100:00100000:1.0:1787365095.445701:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714137216 00000100:00100000:1.0:1787365095.445740:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714137216 00000100:00100000:1.0:1787365095.445864:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365095.445877:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714137216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365095.446022:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714137216:12345-0@lo:400:kworker.0 Request processed in 148us (6965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365095.446029:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365095.446097:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365095.446143:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714137344 00000100:00100000:1.0:1787365095.446148:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714137344 00000100:00100000:1.0:1787365095.446184:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365095.446190:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714137344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365095.446226:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874187714137344:12345-0@lo:400:kworker.0 Request processed in 36us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365095.446233:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787365095.446265:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787365095.446307:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c04b34000 x1874187714137344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365095.446324:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1874187714137344:0@lo:400:kworker.0 00010000:00080000:3.0:1787365095.446490:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c04b35f80 x1874187714137216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365095.446502:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714137216:0@lo:400:kworker.0 00010000:00010000:3.0:1787365095.692597:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365096.717116:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787365097.727281:0:15439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787365097.740884:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787365098.256320:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787365098.763214:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365099.793319:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365100.490956:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365085/real 1787365085] req@ffff9b6c04b37800 x1874187714133120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365100 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365100.490999:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6c04b37800 x1874187714133120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365100 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365100.491012:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365085/real 1787365085] req@ffff9b6c04b35c00 x1874187714133248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365100 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365100.491027:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6c04b35c00 x1874187714133248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365100 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787365100.491074:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6c07207000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365100.491095:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787365100.491101:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714133120:0@lo:8:kworker.0 00000100:00080000:1.0:1787365100.491110:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365100.491122:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787365100.491126:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714133248:0@lo:8:kworker.0 00000100:00080000:0.0:1787365100.491440:0:14335:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787365100.491449:0:14335:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787365100.491454:0:14335:0:(import.c:65:import_set_state_nolock()) ffff9b6c07207000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787365100.491463:0:14335:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:0.0:1787365100.491473:0:14335:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787365100.491483:0:14335:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6c07207000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:1.0:1787365100.491489:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb110b-5671-42a1-88c0-bbf646942aa8:3316:1874187714137472:0@lo:400:kworker.0 00000100:00100000:0.0:1787365100.491521:0:14335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c074ce680 x1874187714137600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787365100.491546:0:14335:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787365100.491551:0:14335:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787365100.491569:0:14335:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787365100.491573:0:14335:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:0.0:1787365100.491577:0:14335:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787365100.491583:0:14335:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d10986000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:1.0:1787365100.491594:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365100.491851:0:14335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c074cdf80 x1874187714137728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787365100.491952:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714137856:0@lo:400:kworker.0 00000100:00100000:1.0:1787365100.491990:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365100.492017:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365100.492024:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714137984:0@lo:400:kworker.0 00000100:00100000:1.0:1787365100.492046:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365100.492077:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714137856 00000100:00100000:1.0:1787365100.492086:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714137856 00000100:00100000:1.0:1787365100.492132:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714137984 00000100:00100000:1.0:1787365100.492135:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714137984 00000100:00100000:1.0:1787365100.492163:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787365100.492171:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714137856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365100.492226:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714137856:12345-0@lo:400:kworker.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365100.492233:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787365100.492250:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365100.492257:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714137984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365100.492300:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714137984:12345-0@lo:400:kworker.0 Request processed in 44us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365100.492305:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787365100.492325:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787365100.492349:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c074cfb80 x1874187714137984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365100.492362:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714137984:0@lo:400:kworker.0 00010000:00080000:1.0:1787365100.492372:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c074ced80 x1874187714137856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365100.492380:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714137856:0@lo:400:kworker.0 00000100:00100000:0.0:1787365100.492480:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714137600:0@lo:8:kworker.0 00000100:00100000:0.0:1787365100.492558:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365100.492622:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714137728:0@lo:8:kworker.0 00000100:00100000:0.0:1787365100.492674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365100.492698:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714137600 00000100:00100000:1.0:1787365100.492704:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714137600 00000100:00100000:1.0:1787365100.492730:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714137728 00000100:00100000:1.0:1787365100.492733:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714137728 00000100:00100000:1.0:1787365100.492749:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365100.492755:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874187714137600:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787365100.492780:0:15074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:1.0:1787365100.492857:0:15074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2c02a 00002000:00100000:1.0:1787365100.492875:0:15074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b6c052df000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787365100.492879:0:15074:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787365100.492883:0:15074:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787365100.493304:0:15074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787365100.493333:0:15074:0:(import.c:65:import_set_state_nolock()) ffff9b6c052dc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365100.493430:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874187714137600:12345-0@lo:8:kworker.0 Request processed in 671us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365100.493454:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365100.493457:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714137472 00000100:00100000:3.0:1787365100.493468:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714137472 00000100:00100000:1.0:1787365100.493480:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365100.493488:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874187714137728:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787365100.493505:0:15074:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787365100.493534:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787365100.493554:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3316:x1874187714137472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365100.493555:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874187714137728:12345-0@lo:8:kworker.0 Request processed in 57us (872us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787365100.493582:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787365100.493675:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3316:x1874187714137472:12345-0@lo:400:kworker.0 Request processed in 129us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365100.493684:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787365100.493732:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c074ce680 x1874187714137600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787365120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365100.493745:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787365100.493754:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787365100.493766:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787365100.493774:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787365100.493778:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6c07207000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787365100.493837:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787365100.493843:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714137600:0@lo:8:kworker.0 00000100:00080000:2.0:1787365100.493857:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787365100.493861:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787365100.493864:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714137728:0@lo:8:kworker.0 00000004:00080000:3.0:1787365100.494064:0:14413:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787365100.494085:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14413:1874187714138240:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787365100.494128:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365100.494169:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365100.494188:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714138240 00000100:00100000:3.0:1787365100.494192:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714138240 00000100:00100000:3.0:1787365100.494236:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365100.494247:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14413:x1874187714138240:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787365100.494281:0:14412:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787365100.495144:0:14412:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 546724356641ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787365100.497008:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb110b-5671-42a1-88c0-bbf646942aa8:3316:1874187714137472:0@lo:400:kworker.0 00000100:00100000:1.0:1787365100.497040:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365100.497070:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714138112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365100.497143:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365100.497266:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714138112 00000100:00100000:2.0:1787365100.497284:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714138112 00000100:00100000:2.0:1787365100.497357:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365100.497367:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874187714138112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365100.497413:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787365100.499326:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787365100.502869:0:15074:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787365100.502883:0:15074:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787365100.502889:0:15074:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:2.0:1787365100.505076:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874187714138112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7701us (7922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365100.505092:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787365100.505847:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c04b35f80 x1874187714138112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365100.505879:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714138112:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1787365100.528018:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.528035:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528059:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.528065:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.528074:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528097:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528109:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528131:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528159:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365100.528693:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.528700:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528712:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.528716:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.528721:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528731:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528739:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528746:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.528775:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787365100.529195:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.529203:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.529218:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.529221:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.529226:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.529236:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.529244:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.529253:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.529260:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787365100.529678:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.529686:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.529696:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.529699:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.529704:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.529713:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.529733:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.530877:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787365100.530893:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.530910:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.530915:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.530926:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.530957:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.530965:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c031 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.530995:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787365100.531000:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531024:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.531027:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531035:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531046:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531053:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c038 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531066:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365100.531070:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531077:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.531080:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531086:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531095:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531109:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c03f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.531123:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365100.531125:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365100.531126:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365100.532287:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.540330:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.540381:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365100.542266:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.542285:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.542309:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.542315:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.542324:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.542343:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.542356:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.542366:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542380:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365100.542395:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542408:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365100.542408:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365100.542417:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542427:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542455:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542462:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c046 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542494:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365100.542497:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542512:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365100.542515:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542522:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542533:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542540:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a502226/0xcfc9272e5fc2c04d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.542555:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.542557:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.542560:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365100.542936:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.543322:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.543331:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.543346:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.543351:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.543357:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.543432:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.543446:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.543456:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.543482:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365100.544127:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.544135:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544147:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.544159:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.544165:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544178:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544187:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544194:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544214:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787365100.544226:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365100.544231:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544239:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878000 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365100.544244:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544253:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544269:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544290:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c054 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544309:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365100.544313:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544320:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365100.544324:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544333:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544343:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544351:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c05b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.544363:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.544424:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.544428:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.545182:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.545192:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545215:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.545219:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.545225:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545237:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545246:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545254:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545270:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365100.545281:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365100.545287:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545296:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365100.545300:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545311:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545337:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545345:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c062 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.545425:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.545428:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.545431:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.546060:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.546068:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546079:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.546083:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.546088:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546099:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546109:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546117:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546160:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365100.546250:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365100.546259:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.546268:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879400 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365100.546273:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.546285:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.546321:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.546333:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c069 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.546370:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.546373:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.546375:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.546734:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.546741:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546753:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.546757:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.546763:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546898:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546909:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546918:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546938:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365100.546951:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365100.546957:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.546959:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546971:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365100.546983:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.546993:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.547007:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.547015:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c070 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.547032:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.547034:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.547037:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.547734:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.547745:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.547760:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.547765:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.547865:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.547877:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.547887:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.547902:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.547920:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365100.547930:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365100.547939:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.547950:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365100.547955:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.547964:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.547978:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.547986:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c077 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.548020:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.548022:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.548025:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.548376:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.548382:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.548392:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.548396:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.548400:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.548410:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.548418:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.548425:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.548449:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365100.548722:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365100.548729:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.548739:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365100.548743:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.548751:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.548765:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.548771:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c07e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.548811:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.548813:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.548814:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.549095:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.549102:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549119:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.549123:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.549127:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549139:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549149:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549157:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549180:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365100.549460:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365100.549468:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.549492:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365100.549496:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.549505:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.549518:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.549525:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c085 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.549545:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.549547:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.549549:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.549738:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.549745:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549755:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.549759:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.549764:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549880:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549900:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549908:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.549928:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365100.550269:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365100.550276:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.550286:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365100.550290:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.550299:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.550321:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.550330:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069efeef/0xcfc9272e5fc2c08c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.550352:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.550354:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.550357:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.550370:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.550377:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.550387:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.550392:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.550396:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.550406:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.550413:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.550421:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.550457:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365100.551194:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.551203:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551215:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.551219:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.551224:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551234:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551244:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551252:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551270:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787365100.551280:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365100.551285:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551295:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365100.551305:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551314:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551330:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551336:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024791516/0xcfc9272e5fc2c093 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551356:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365100.551360:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551367:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365100.551370:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551377:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551387:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551395:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c09a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.551418:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.551419:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.551421:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.551569:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.552007:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.552014:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552025:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.552029:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.552033:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552043:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552051:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552057:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552083:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365100.552671:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.552678:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552699:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.552704:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.552709:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552720:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.552726:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365100.552730:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.552737:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552741:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.552759:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365100.552766:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552771:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365100.552780:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.552826:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365100.552830:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.552839:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c0a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365100.552876:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.552879:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365100.552881:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365100.553655:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.553665:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.553678:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.553682:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.553688:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.553700:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.553716:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.553723:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.553752:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365100.554204:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.554211:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.554221:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.554225:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.554230:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.554239:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.554248:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.554255:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.554277:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787365100.555088:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.555097:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555112:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.555116:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.555122:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555133:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555142:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555149:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555159:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787365100.555768:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.555775:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555836:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.555847:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.555852:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555863:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555872:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555879:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.555888:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787365100.556283:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.556290:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.556300:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.556304:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.556308:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.556319:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.556327:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.556342:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.556351:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787365100.556988:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.556996:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.557008:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.557012:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.557016:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.557026:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.557034:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.557041:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.557051:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1787365100.557842:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.557851:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558089:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.558094:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.558101:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558115:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558125:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558133:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558144:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1787365100.558750:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.558758:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558770:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.558774:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.558779:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558826:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558847:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558854:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.558863:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1787365100.559295:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.559302:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559311:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.559315:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.559320:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559329:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559339:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559347:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559370:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1787365100.559931:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365100.559938:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559949:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1787365100.559952:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365100.559957:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559967:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559976:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559984:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.559994:0:15074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00080000:0.0:1787365100.560173:0:15074:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1787365100.560323:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14413:x1874187714138240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 66073us (66189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365100.560350:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787365100.560432:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14413:1874187714138240:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787365100.560463:0:14413:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787365100.560624:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14413:1874187714138368:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787365100.560683:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365100.560730:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40113d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787365100.560762:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714138368 00000100:00100000:0.0:1787365100.560771:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714138368 00000100:00100000:0.0:1787365100.560847:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365100.560857:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14413:x1874187714138368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787365100.560911:0:15076:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1787365100.561113:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1787365100.561125:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561138:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.561144:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561156:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561180:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561199:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c084b015/0xcfc9272e5fc2c0af lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561229:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1787365100.561233:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561247:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.561250:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561258:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561268:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561274:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c0b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561289:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1787365100.561293:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561299:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.561302:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561309:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561317:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561331:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c0bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561351:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787365100.561356:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561362:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.561366:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561373:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561381:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561399:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c0c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561414:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787365100.561418:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561424:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878000 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.561433:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561441:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561451:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561458:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c0cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561473:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787365100.561477:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561482:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.561485:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561492:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561500:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.561507:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006385ec3d/0xcfc9272e5fc2c0d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564705:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787365100.564715:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564730:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.564737:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564749:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564777:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564807:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c0d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564832:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787365100.564837:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564844:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5400 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.564848:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564872:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564885:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564895:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f46d08e1/0xcfc9272e5fc2c0e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564916:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787365100.564921:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564928:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.564931:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564939:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564948:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564956:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebbca215/0xcfc9272e5fc2c0e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564987:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365100.564991:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.564998:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365100.565003:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.565010:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.565021:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.565028:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386098af/0xcfc9272e5fc2c0ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.565043:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365100.565047:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365100.565050:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365100.568364:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14413:x1874187714138368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7494us (7666us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787365100.568384:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365100.568470:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14413:1874187714138368:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787365100.568592:0:14413:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1787365100.575419:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365100.575429:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365100.575433:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.575446:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.575467:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365100.575474:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.575487:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.575603:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.575623:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c0a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365100.575667:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.575669:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365100.575671:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787365100.606763:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00100000:0.0:1787365100.648824:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787365100.814837:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365101.839947:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365102.858990:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365103.887199:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365104.909378:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365105.685907:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365105.685929:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714138496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365105.686000:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787365105.686322:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365105.686328:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787365105.686331:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787365105.686337:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 546 00000100:00080000:3.0:1787365105.686343:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787365105.686350:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d10986000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:3.0:1787365105.686374:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c04b36d80 x1874187714138752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787365105.686434:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714138496 00000100:00100000:3.0:1787365105.686441:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714138496 00000100:00100000:3.0:1787365105.686492:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787365105.686503:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874187714138496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365105.686540:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365105.686594:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874187714138496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.686601:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787365105.686622:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714138880:0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.686648:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.686670:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365105.686676:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07eb110b-5671-42a1-88c0-bbf646942aa8:3314:1874187714138624:0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.686704:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.687318:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714138752:0@lo:8:kworker.0 00000100:00100000:3.0:1787365105.687349:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787365105.687382:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365105.687401:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714138880 00000100:00100000:3.0:1787365105.687406:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714138880 00000100:00100000:3.0:1787365105.687442:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787365105.687450:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714138880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.687492:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714138880:12345-0@lo:400:kworker.0 Request processed in 43us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.687500:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787365105.687519:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714138624 00000100:00100000:3.0:1787365105.687523:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714138624 00000100:00100000:3.0:1787365105.687558:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787365105.687565:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3314:x1874187714138624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.687596:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3314:x1874187714138624:12345-0@lo:400:kworker.0 Request processed in 31us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.687602:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787365105.687640:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714139008:0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.687665:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.687709:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714138496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365105.689491:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714138752 00000100:00100000:0.0:1787365105.689503:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714138752 00000100:00100000:0.0:1787365105.689550:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365105.689559:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1874187714138752:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787365105.689580:0:15075:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787365105.690903:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714139008 00000100:00100000:3.0:1787365105.690911:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714139008 00000100:00100000:3.0:1787365105.690962:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787365105.690971:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714139008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.691073:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714139008:12345-0@lo:400:kworker.0 Request processed in 103us (3406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.691090:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787365105.702342:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365105.702559:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07eb110b-5671-42a1-88c0-bbf646942aa8:3314:1874187714138624:0@lo:400:kworker.0 00010000:00080000:3.0:1787365105.702579:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c04b34a80 x1874187714138880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365105.702592:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714138880:0@lo:400:kworker.0 00010000:00080000:3.0:1787365105.702631:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c04b36300 x1874187714139008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365105.702641:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714139008:0@lo:400:kworker.0 00000100:00100000:0.0:1787365105.734706:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1874187714138752:12345-0@lo:8:kworker.0 Request processed in 45140us (47348us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787365105.734721:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787365105.741901:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787365105.741912:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787365105.741918:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714138752:0@lo:8:kworker.0 00000020:01000004:3.0:1787365105.795924:0:15794:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787365105.795928:0:15794:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787365105.796040:0:15794:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b6d33f24000 00000020:01000004:3.0:1787365105.796058:0:15794:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787365105.796072:0:15794:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787365105.796111:0:15794:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b6c05314d28) 00000020:00000080:3.0:1787365105.796131:0:15794:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00000001:00080000:0.0:1787365105.816727:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00100000:10000000:3.0:1787365105.820995:0:15794:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787365105.821367:0:15794:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787365105.822383:0:15794:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787365105.822704:0:15794:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787365105.823147:0:15794:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787365105.823709:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 423: rc = 0 00100000:10000000:3.0:1787365105.823893:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 423: rc = 0 00100000:10000000:3.0:1787365105.823997:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 423: rc = 0 00100000:10000000:3.0:1787365105.824660:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00100000:10000000:3.0:1787365105.825075:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1787365105.825427:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1787365105.825881:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:3.0:1787365105.826136:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:3.0:1787365105.826515:0:15794:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00000020:00000080:3.0:1787365105.827510:0:15794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787365105.827588:0:15794:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787365105.827601:0:15794:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcfc9272e5fc2c0fc 00000020:01000004:3.0:1787365105.827610:0:15794:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787365105.827632:0:15794:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787365105.827635:0:15794:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787365105.827641:0:15794:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787365105.827666:0:15794:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787365105.827670:0:15794:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787365105.838119:0:15794:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787365105.838159:0:15794:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.102@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787365105.838164:0:15794:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787365105.838165:0:15794:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365105.838167:0:15794:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365105.838242:0:15794:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365105.838243:0:15794:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365105.838245:0:15794:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365105.838246:0:15794:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365105.838248:0:15794:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365105.838249:0:15794:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787365105.838253:0:15794:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787365105.838255:0:15794:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787365105.838257:0:15794:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365105.838263:0:15794:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365105.838265:0:15794:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365105.838266:0:15794:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365105.838267:0:15794:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365105.838268:0:15794:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365105.838269:0:15794:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365105.838270:0:15794:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787365105.838296:0:15794:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787365105.838315:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139136:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787365105.838400:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.838534:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02e156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.838758:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714139136 00000100:00100000:0.0:1787365105.838765:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714139136 00000100:00100000:0.0:1787365105.839010:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787365105.839022:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15794:x1874187714139136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787365105.839061:0:14384:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787365105.839064:0:14384:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787365105.839068:0:14384:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787365105.845402:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15794:x1874187714139136:12345-0@lo:253:mount.lustre.0 Request processed in 6373us (6991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365105.845418:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787365105.845511:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787365105.845598:0:15794:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787365105.845602:0:15794:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787365105.845604:0:15794:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365105.845605:0:15794:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365105.845606:0:15794:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365105.845607:0:15794:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365105.845608:0:15794:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365105.845610:0:15794:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365105.845612:0:15794:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365105.845613:0:15794:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787365105.845636:0:15794:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d33f24000 from lustre-OST0001 10000000:01000000:3.0:1787365105.845688:0:15794:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787365105.845692:0:15794:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787365105.845699:0:15794:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6d04f53370 local copy 00010000:00010000:3.0:1787365105.845710:0:15794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365105.846015:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365105.846056:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.846137:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40114000 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.846244:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714139264 00000100:00100000:0.0:1787365105.846251:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714139264 00000100:00100000:0.0:1787365105.846332:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787365105.846342:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15794:x1874187714139264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365105.846641:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15794:x1874187714139264:12345-0@lo:501:mount.lustre.0 Request processed in 299us (583us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787365105.846649:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787365105.846728:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139264:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787365105.846751:0:15794:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787365105.846951:0:15794:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787365105.846959:0:15794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.846969:0:15794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0000/0xcfc9272e5fc2bea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2bea9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365105.846990:0:15794:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d33f24000 10000000:01000000:1.0:1787365105.846996:0:15794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787365105.847001:0:15794:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787365105.847004:0:15794:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365105.847009:0:15794:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787365105.847012:0:15794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787365105.847039:0:15794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2c103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.847047:0:15794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2c103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.847056:0:15794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2c103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365105.847073:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365105.847108:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365105.847394:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11610000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365105.847472:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714139392 00000100:00100000:3.0:1787365105.847478:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714139392 00000100:00100000:3.0:1787365105.847511:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787365105.847528:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+16:15794:x1874187714139392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365105.847537:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365105.847559:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d013c9600/0xcfc9272e5fc2c10a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2c103 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.847581:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d013c9600/0xcfc9272e5fc2c10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c103 expref: 17 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.847592:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d013c9600/0xcfc9272e5fc2c10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c103 expref: 17 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.847601:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c9600, rc 0) 00000100:00100000:3.0:1787365105.847683:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139392:12345-0@lo:101:mount.lustre.0 Request processed in 164us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.847689:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787365105.847942:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365105.847956:0:15794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2c103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c10a expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.847972:0:15794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2c103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2c10a expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365105.848912:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787365105.850025:0:15794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787365105.850303:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787365105.850349:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787365105.850383:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787365105.850429:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787365105.850466:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787365105.850501:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787365105.850721:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787365105.850729:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787365105.850846:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365105.850911:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365105.850963:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d01254240 going to sleep for 11 seconds 00000100:00100000:1.0:1787365105.851053:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714139520 00000100:00100000:1.0:1787365105.851061:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714139520 00000100:00100000:1.0:1787365105.851109:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787365105.851118:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365105.851929:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139520:12345-0@lo:501:mount.lustre.0 Request processed in 809us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365105.851939:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787365105.852394:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365105.852460:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787365105.852510:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.852559:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98600 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.852686:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714139648 00000100:00100000:0.0:1787365105.852693:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714139648 00000100:00100000:0.0:1787365105.852728:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787365105.852736:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d18192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365105.853086:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d18192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139648:12345-0@lo:503:mount.lustre.0 Request processed in 349us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.853094:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787365105.853310:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787365105.854663:0:15794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787365105.854763:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365105.855049:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.855126:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98600 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.855248:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714139776 00000100:00100000:0.0:1787365105.855266:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714139776 00000100:00100000:0.0:1787365105.855362:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787365105.855372:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d18192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787365105.855648:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d18192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139776:12345-0@lo:502:mount.lustre.0 Request processed in 277us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.855658:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787365105.855748:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787365105.856025:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787365105.856071:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787365105.856099:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787365105.856142:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787365105.856183:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787365105.856212:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787365105.856249:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787365105.856277:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787365105.856312:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787365105.856340:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365105.856382:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.856868:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98600 going to sleep for 11 seconds 00000100:00100000:1.0:1787365105.856952:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714139904 00000100:00100000:1.0:1787365105.856958:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714139904 00000100:00100000:1.0:1787365105.856991:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787365105.856998:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d18190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365105.857256:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714139904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787365105.857326:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787365105.857336:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000100:00100000:1.0:1787365105.857939:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d18190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714139904:12345-0@lo:502:mount.lustre.0 Request processed in 167us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365105.857950:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000020:01000000:1.0:1787365105.858425:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787365105.858432:0:15796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787365105.858438:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365105.858440:0:15796:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787365105.858444:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787365105.858459:0:15796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b6d3ff599b8) 00000020:00000080:1.0:1787365105.858481:0:15796:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787365105.858485:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787365105.858576:0:15796:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d33f24000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787365105.858582:0:15796:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787365105.858593:0:15796:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcfc9272e5fc2c118 00010000:00010000:1.0:1787365105.862688:0:15796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787365105.863394:0:15796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787365105.866052:0:15796:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787365105.867745:0:15796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787365105.867770:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365105.867810:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.867813:0:15796:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787365105.867831:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365105.867837:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.867838:0:15796:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787365105.867842:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787365105.867844:0:15796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787365105.867846:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365105.867849:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.867850:0:15796:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787365105.867852:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365105.867854:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.867855:0:15796:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787365105.867858:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787365105.867911:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365105.867914:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.867915:0:15796:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787365105.867918:0:15796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787365105.868359:0:15794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787365105.868387:0:15794:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787365105.868411:0:15794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2c103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c10a expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.868423:0:15794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0e00/0xcfc9272e5fc2c103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c10a expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365105.868431:0:15794:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d33f24000 from 1 10000000:01000000:3.0:1787365105.868434:0:15794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365105.868470:0:15794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.868478:0:15794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.868510:0:15794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365105.868536:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787365105.868613:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.868655:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40114180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365105.868978:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714140032 00000100:00100000:1.0:1787365105.868985:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714140032 00000100:00100000:1.0:1787365105.869024:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787365105.869034:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d18193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+17:15794:x1874187714140032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365105.869049:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365105.869062:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2c11f expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.869087:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.869098:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.869107:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0200, rc 0) 00000100:00100000:1.0:1787365105.869245:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d18193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140032:12345-0@lo:101:mount.lustre.0 Request processed in 211us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365105.869252:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787365105.871907:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365105.871936:0:15794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365105.871949:0:15794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365105.872494:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787365105.873125:0:15794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365105.873342:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787365105.873386:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787365105.873448:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787365105.873456:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787365105.874458:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365105.874619:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.874761:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98600 going to sleep for 11 seconds 00000100:00100000:3.0:1787365105.874901:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714140160 00000100:00100000:3.0:1787365105.874908:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714140160 00000100:00100000:3.0:1787365105.874991:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787365105.875001:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d18191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365105.875263:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d18191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140160:12345-0@lo:501:mount.lustre.0 Request processed in 263us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.875270:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787365105.875341:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365105.875374:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787365105.875412:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.875430:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98600 going to sleep for 11 seconds 00000100:00100000:3.0:1787365105.875464:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714140288 00000100:00100000:3.0:1787365105.875468:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714140288 00000100:00100000:3.0:1787365105.875495:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787365105.875580:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d18193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140288:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365105.876148:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d18193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140288:12345-0@lo:503:mount.lustre.0 Request processed in 645us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.876155:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787365105.876220:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787365105.876988:0:15794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787365105.877058:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365105.877112:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.877193:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98600 going to sleep for 11 seconds 00000100:00100000:3.0:1787365105.877232:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714140416 00000100:00100000:3.0:1787365105.877238:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714140416 00000100:00100000:3.0:1787365105.877280:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787365105.877289:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365105.877536:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140416:12345-0@lo:502:mount.lustre.0 Request processed in 247us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.877562:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787365105.877737:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787365105.878200:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787365105.878254:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787365105.878305:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787365105.878342:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787365105.878373:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787365105.878418:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787365105.878453:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787365105.878485:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787365105.878601:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365105.878654:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.878825:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98600 going to sleep for 11 seconds 00000100:00100000:3.0:1787365105.878930:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714140544 00000100:00100000:3.0:1787365105.878937:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714140544 00000100:00100000:3.0:1787365105.878978:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787365105.878987:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365105.879193:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140544:12345-0@lo:502:mount.lustre.0 Request processed in 206us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.879200:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787365105.879274:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787365105.879366:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787365105.879382:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787365105.880895:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365105.880907:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.880910:0:15800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787365105.880916:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d33f24000 00000020:00000080:2.0:1787365105.880918:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787365105.880924:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365105.880927:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.880928:0:15800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787365105.880930:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365105.880932:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.880934:0:15800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787365105.880936:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d33f24000 00000020:00000080:2.0:1787365105.880938:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787365105.880996:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365105.880999:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.881001:0:15800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787365105.881003:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365105.881005:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.881006:0:15800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787365105.881009:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d33f24000 00000020:00000080:2.0:1787365105.881011:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787365105.881043:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365105.881046:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365105.881048:0:15800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787365105.881051:0:15800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787365105.881612:0:15794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787365105.881642:0:15794:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365105.881672:0:15794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.881685:0:15794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365105.881735:0:15794:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787365105.881739:0:15794:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d33f24000 10000000:01000000:3.0:1787365105.881742:0:15794:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d33f24000 10000000:01000000:3.0:1787365105.881745:0:15794:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787365105.881760:0:15794:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6d33f24000 from 1 10000000:01000000:3.0:1787365105.881763:0:15794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787365105.881813:0:15794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2c12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.881823:0:15794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2c12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.881833:0:15794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2c12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365105.881863:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787365105.881922:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.881963:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714140672 00000100:00100000:3.0:1787365105.881970:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714140672 00000100:00100000:3.0:1787365105.882005:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787365105.882013:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714140672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365105.882025:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365105.882038:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d013c8a00/0xcfc9272e5fc2c134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2c12d expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.882060:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d013c8a00/0xcfc9272e5fc2c134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c12d expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.882072:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d013c8a00/0xcfc9272e5fc2c134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c12d expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.882080:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d013c8a00, rc 0) 00000100:00100000:3.0:1787365105.882112:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714140672:12345-0@lo:101:mount.lustre.0 Request processed in 99us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.882119:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787365105.882164:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40114a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787365105.882184:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365105.882198:0:15794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2c12d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c134 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365105.882206:0:15794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2c12d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2c134 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787365105.883157:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787365105.883738:0:15794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787365105.884097:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787365105.884142:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787365105.884176:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787365105.884236:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787365105.884276:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787365105.884318:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787365105.884345:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787365105.884372:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787365105.884410:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787365105.884441:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787365105.884473:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787365105.885481:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787365105.885627:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787365105.885957:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787365105.886015:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787365105.886051:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787365105.886078:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787365105.886138:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787365105.886179:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787365105.886213:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787365105.886262:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787365105.886297:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787365105.886332:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787365105.886380:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787365105.886413:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787365105.886447:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787365105.886489:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787365105.886609:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787365105.886642:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787365105.886929:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787365105.886965:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787365105.886998:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787365105.887033:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787365105.887081:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787365105.887117:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787365105.887165:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787365105.887200:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787365105.887295:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787365105.887304:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787365105.887408:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365105.887479:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.887626:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d40114a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.887738:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714140800 00000100:00100000:0.0:1787365105.887747:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714140800 00000100:00100000:0.0:1787365105.887882:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787365105.887892:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714140800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365105.888121:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714140800:12345-0@lo:501:mount.lustre.0 Request processed in 230us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.888129:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787365105.888181:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365105.888217:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365105.888268:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365105.888292:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714140928 00000100:00100000:0.0:1787365105.888296:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714140928 00000100:00100000:0.0:1787365105.888318:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787365105.888324:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714140928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365105.890018:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714140928:12345-0@lo:503:mount.lustre.0 Request processed in 1690us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.890030:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787365105.890102:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d01254840 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.890126:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714140928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787365105.892284:0:15794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365105.892380:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714141056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365105.892457:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365105.893066:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714141056 00000100:00100000:0.0:1787365105.893075:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714141056 00000100:00100000:0.0:1787365105.893118:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787365105.893128:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714141056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365105.893290:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11610240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.893451:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714141056:12345-0@lo:502:mount.lustre.0 Request processed in 323us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.893459:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787365105.893622:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714141056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365105.894066:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787365105.894649:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787365105.894684:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787365105.895008:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787365105.895052:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787365105.895348:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787365105.895390:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787365105.895425:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787365105.895472:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787365105.895508:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787365105.895565:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787365105.895620:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787365105.895657:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787365105.895692:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787365105.895760:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787365105.895826:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787365105.895863:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787365105.895909:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787365105.895945:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787365105.895981:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787365105.896028:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787365105.896062:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787365105.896111:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787365105.896162:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787365105.896689:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787365105.897031:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787365105.899115:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787365105.899717:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787365105.899867:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787365105.899945:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787365105.899983:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787365105.900018:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787365105.900051:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787365105.900676:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787365105.900921:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787365105.900975:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787365105.901009:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787365105.901066:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787365105.901131:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787365105.901887:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787365105.901948:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714141184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365105.902032:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365105.902674:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11610240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.902744:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714141184 00000100:00100000:0.0:1787365105.902835:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714141184 00000100:00100000:0.0:1787365105.902891:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787365105.902901:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714141184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787365105.903165:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714141184:12345-0@lo:502:mount.lustre.0 Request processed in 265us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.903174:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787365105.903200:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714141184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365105.903297:0:15794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787365105.903309:0:15794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787365105.906938:0:15805:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787365105.906957:0:15805:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b6d3ff5cd28) 00000020:00000080:1.0:1787365105.907054:0:15805:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787365105.907157:0:15805:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d33f24000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787365105.907162:0:15805:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d33f24000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787365105.907165:0:15805:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6d33f24000 3 00010000:00080000:1.0:1787365105.908304:0:15805:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6c05f9e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.102@tcp at head 00010000:00010000:1.0:1787365105.912608:0:15805:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787365105.912876:0:15805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787365105.913376:0:15805:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787365105.913391:0:15805:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcfc9272e5fc2c142 00000100:00080000:1.0:1787365105.913404:0:15805:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787365105.913412:0:15805:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b6c05f9e000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:1.0:1787365105.913452:0:15805:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d342d5880 x1874187714141312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787365105.913485:0:15805:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787365105.913550:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874187714141312:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787365105.913622:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.913680:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714141312 00000100:00100000:2.0:1787365105.913686:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714141312 00000100:00100000:2.0:1787365105.913718:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365105.913743:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1874187714141312:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787365105.913774:0:14391:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:2.0:1787365105.913824:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcfc9272e5fc2c149 00000004:00100000:2.0:1787365105.913839:0:14391:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787365105.913871:0:14391:0:(import.c:65:import_set_state_nolock()) ffff9b6c052d8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365105.913920:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874187714141312:12345-0@lo:38:llog_process_th.0 Request processed in 176us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365105.913928:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787365105.913967:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d342d5880 x1874187714141312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365105.913977:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787365105.913984:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787365105.913990:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787365105.913995:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787365105.913997:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6c05f9e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787365105.914003:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1874187714141312:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787365105.919208:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365105.919216:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787365105.919220:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787365105.919230:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 551 00000100:00080000:3.0:1787365105.919234:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787365105.919242:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d10986000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:3.0:1787365105.919276:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6c04b35180 x1874187714141568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787365105.919336:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714141824:0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.919401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.919440:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365105.919445:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714141696:0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.919467:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.919497:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714141824 00000100:00100000:3.0:1787365105.919504:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714141824 00000100:00100000:2.0:1787365105.919704:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714141440:0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.919845:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714141696 00000100:00100000:3.0:1787365105.919849:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714141696 00000100:00100000:3.0:1787365105.919864:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365105.919872:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714141824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.919920:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714141824:12345-0@lo:400:kworker.0 Request processed in 48us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.919926:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365105.919942:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787365105.919948:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714141696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365105.919973:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714141696:12345-0@lo:400:kworker.0 Request processed in 27us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365105.919979:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787365105.920010:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c04b34a80 x1874187714141696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365105.920025:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714141696:0@lo:400:kworker.0 00010000:00080000:3.0:1787365105.920034:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6c04b36300 x1874187714141824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365105.920041:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714141824:0@lo:400:kworker.0 00000100:00100000:2.0:1787365105.920280:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.920463:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714141568:0@lo:8:kworker.0 00000100:00100000:2.0:1787365105.920495:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787365105.921048:0:15805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1787365105.921991:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714141440 00000100:00100000:0.0:1787365105.921999:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714141440 00000020:01000000:2.0:1787365105.922007:0:15794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787365105.922036:0:15794:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1787365105.922046:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714141568 00000100:00100000:0.0:1787365105.922049:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714141568 00000100:00100000:0.0:1787365105.922065:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365105.922074:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714141440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365105.922100:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787365105.922109:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787365105.922210:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365105.922216:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1874187714141568:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787365105.922234:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714141440:12345-0@lo:400:kworker.0 Request processed in 162us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.922241:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365105.922271:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1874187714141568:12345-0@lo:8:kworker.0 Request processed in 54us (1775us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787365105.922277:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365105.922281:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787365105.922297:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714141440:0@lo:400:kworker.0 00000100:00100000:1.0:1787365105.922302:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787365105.922308:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365105.922311:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787365105.922314:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714141568:0@lo:8:kworker.0 00010000:00010000:2.0:1787365105.922463:0:15794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2c12d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c134 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365105.922474:0:15794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d013c8000/0xcfc9272e5fc2c12d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c134 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787365105.922717:0:15794:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787365105.923043:0:15794:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365105.923044:0:15794:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365105.923046:0:15794:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365105.923047:0:15794:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365105.923049:0:15794:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365105.923050:0:15794:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365105.923052:0:15794:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365105.923053:0:15794:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787365105.923057:0:15794:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787365105.923060:0:15794:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787365105.923067:0:15794:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365105.923069:0:15794:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365105.923070:0:15794:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365105.923071:0:15794:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365105.923072:0:15794:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365105.923073:0:15794:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365105.923074:0:15794:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365105.923074:0:15794:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787365105.923160:0:15794:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787365105.923611:0:15794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714141952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787365105.923672:0:15794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365105.923708:0:15794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02e156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.924246:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714141952 00000100:00100000:0.0:1787365105.924268:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714141952 00000100:00100000:0.0:1787365105.924394:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787365105.924404:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:15794:x1874187714141952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787365105.924433:0:14384:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787365105.924447:0:14384:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1787365105.931913:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787365105.955032:0:14384:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787365105.955051:0:14384:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787365105.955115:0:14406:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787365105.955120:0:14406:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787365105.955144:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.955165:0:14406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.955185:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.955242:0:14406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365105.955256:0:14406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 19 pid: 14384 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365105.955271:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1874187714142080:0@lo:104: 00000100:00100000:1.0:1787365105.955346:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365105.955408:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11610240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365105.955667:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714142080 00000100:00100000:0.0:1787365105.955675:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714142080 00000100:00100000:0.0:1787365105.955730:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365105.955740:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07eb110b-5671-42a1-88c0-bbf646942aa8+3:14406:x1874187714142080:12345-0@lo:104: 00010000:00010000:0.0:1787365105.955754:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.955831:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787365105.955838:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07eb110b-5671-42a1-88c0-bbf646942aa8+3:14406:x1874187714142080:12345-0@lo:104: Request processed in 100us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.955845:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787365105.955867:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365105.955873:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.955880:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0600 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787365105.955884:0:14378:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.955893:0:14378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365105.955900:0:14378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365105.955916:0:14378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787365105.955946:0:14378:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.955953:0:14378:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365105.955971:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.955979:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0600/0xcfc9272e5fc2c01c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2c023 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.955996:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365105.955998:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365105.956000:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365105.956021:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714142208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365105.956053:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365105.956094:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714142208 00000100:00100000:0.0:1787365105.956099:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714142208 00010000:00010000:0.0:1787365105.956116:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 20 pid: 14384 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365105.956137:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365105.956144:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+20:3315:x1874187714142208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365105.956156:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365105.956162:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 20 pid: 14384 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956247:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 20 pid: 14384 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956270:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956279:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787365105.956293:0:14376:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002958989s 00010000:00010000:0.0:1787365105.956297:0:14376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956304:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956311:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956317:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956322:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365105.956326:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956334:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956342:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956353:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365105.956384:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+20:3315:x1874187714142208:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365105.956397:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365105.956435:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714142208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365105.956462:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d013c9800/0xcfc9272e5fc2c023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2c01c expref: 19 pid: 14384 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365105.956472:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1874187714142080:0@lo:104: 00010000:00010000:0.0:1787365105.956484:0:14406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956494:0:14406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956500:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365105.956506:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c1c00/0xcfc9272e5fc2c150 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365105.965597:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+18:15794:x1874187714141952:12345-0@lo:253:mount.lustre.0 Request processed in 41185us (41915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365105.965614:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787365105.965745:0:15794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07eb110b-5671-42a1-88c0-bbf646942aa8:15794:1874187714141952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787365105.965761:0:15794:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787365105.965764:0:15794:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787365105.965766:0:15794:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365105.965767:0:15794:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365105.965768:0:15794:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365105.965770:0:15794:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365105.965771:0:15794:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365105.965772:0:15794:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365105.965774:0:15794:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365105.965775:0:15794:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787365105.965858:0:15794:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787365105.974975:0:15794:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365105.975303:0:15794:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365105.975458:0:15794:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365105.975679:0:15794:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365105.976031:0:15794:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365105.976324:0:15794:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787365105.977456:0:15794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787365106.028737:0:15794:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787365106.028746:0:15794:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787365106.028813:0:15794:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787365106.028882:0:15794:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787365106.028898:0:15794:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787365106.028926:0:15794:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787365106.956104:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787365107.022702:0:14387:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787365107.022711:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6c07201000 from 8 10000000:01000000:0.0:1787365107.022715:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787365107.022762:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2c157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365107.022775:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2c157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365107.022930:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2c157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365107.022965:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714142336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787365107.023035:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365107.023089:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365107.023157:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714142336 00000100:00100000:2.0:1787365107.023165:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714142336 00000100:00100000:2.0:1787365107.023221:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787365107.023231:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+18:14387:x1874187714142336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365107.023243:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365107.023256:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34449200/0xcfc9272e5fc2c15e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2c157 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365107.023279:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34449200/0xcfc9272e5fc2c15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c157 expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365107.023290:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34449200/0xcfc9272e5fc2c15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c157 expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365107.023307:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449200, rc 0) 00000100:00100000:2.0:1787365107.023357:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:14387:x1874187714142336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365107.023365:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787365107.023755:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714142336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365107.023769:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2c157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c15e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365107.023778:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2c157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2c15e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365107.024140:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714142464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787365107.024182:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365107.026348:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365107.032501:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714142464 00000100:00100000:3.0:1787365107.032524:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714142464 00000100:00100000:3.0:1787365107.032582:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787365107.032593:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:14387:x1874187714142464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787365107.032619:0:14384:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787365107.032645:0:14384:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787365107.032649:0:14384:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787365107.032804:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:14387:x1874187714142464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 192us (8600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365107.032830:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787365107.032886:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714142464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787365107.032969:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787365107.032980:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2c157 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c15e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365107.032990:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d342e4e00/0xcfc9272e5fc2c157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c15e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365107.978888:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787365108.494701:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787365109.003930:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365110.028195:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365110.808663:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714142592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365110.810096:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365110.812061:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714142592 00000100:00100000:3.0:1787365110.812083:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714142592 00000100:00100000:3.0:1787365110.812166:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365110.812180:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714142592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365110.812963:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365110.813074:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874187714142592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 897us (2987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365110.813084:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787365110.813166:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365110.813998:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714142592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787365111.051088:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787365111.320005:0:14335:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365111.320014:0:14335:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787365111.320019:0:14335:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787365111.320037:0:14335:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d10986000 using connection 192.168.204.102@tcp/0@lo 00000100:00100000:2.0:1787365111.320071:0:14335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d40e19f80 x1874187714142848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787365111.320153:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb110b-5671-42a1-88c0-bbf646942aa8:3313:1874187714142720:0@lo:400:kworker.0 00000100:00100000:1.0:1787365111.320610:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714142848:0@lo:8:kworker.0 00000100:00100000:1.0:1787365111.320694:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.321332:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714142976:0@lo:400:kworker.0 00000100:00100000:3.0:1787365111.321537:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.321645:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714143104:0@lo:400:kworker.0 00000100:00100000:3.0:1787365111.321673:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.322964:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365111.322984:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714143232:0@lo:400:kworker.0 00000100:00100000:0.0:1787365111.323403:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714142848 00000100:00100000:0.0:1787365111.323421:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714142848 00000100:00100000:2.0:1787365111.323732:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.323808:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714142720 00000100:00100000:0.0:1787365111.323994:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365111.324004:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1874187714142848:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787365111.324045:0:15074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:0.0:1787365111.324085:0:15074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfc9272e5fc2c165 00002000:00100000:0.0:1787365111.324103:0:15074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b6d0fddc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787365111.324125:0:15074:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787365111.324129:0:15074:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787365111.324929:0:15074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787365111.324975:0:15074:0:(import.c:65:import_set_state_nolock()) ffff9b6d0fdda800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787365111.325065:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874187714142848:12345-0@lo:8:kworker.0 Request processed in 1061us (4370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365111.325075:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365111.326090:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714142976 00000100:00100000:0.0:1787365111.326104:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714142976 00000100:00100000:0.0:1787365111.326163:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714143104 00000100:00100000:0.0:1787365111.326167:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714143104 00000100:00100000:0.0:1787365111.326214:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787365111.326223:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714142976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365111.326306:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714142976:12345-0@lo:400:kworker.0 Request processed in 83us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365111.326314:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787365111.326329:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787365111.326336:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714143104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365111.326734:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714142720 00000100:00100000:2.0:1787365111.326801:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787365111.326904:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3313:x1874187714142720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365111.326969:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3313:x1874187714142720:12345-0@lo:400:kworker.0 Request processed in 161us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.326977:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787365111.327053:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb110b-5671-42a1-88c0-bbf646942aa8:3313:1874187714142720:0@lo:400:kworker.0 00000100:00100000:0.0:1787365111.327520:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714143104:12345-0@lo:400:kworker.0 Request processed in 1183us (5845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365111.327528:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365111.328158:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787365111.328228:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d40e19180 x1874187714143104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365111.328244:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714143104:0@lo:400:kworker.0 00000100:00100000:3.0:1787365111.328297:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714143232 00000100:00100000:3.0:1787365111.328303:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714143232 00000100:00100000:3.0:1787365111.328354:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787365111.328363:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714143232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365111.328704:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714143232:12345-0@lo:400:kworker.0 Request processed in 340us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.328713:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787365111.328798:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d40e18e00 x1874187714143232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365111.328833:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714143232:0@lo:400:kworker.0 00000100:00080000:3.0:1787365111.328845:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787365111.328882:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d40e1ad80 x1874187714142976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365111.328893:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714142976:0@lo:400:kworker.0 00010000:00080000:1.0:1787365111.330684:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d40e19f80 x1874187714142848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787365136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787365111.330722:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787365111.330736:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787365111.330744:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787365111.330750:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b6d10986000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787365111.330825:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787365111.330834:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1874187714142848:0@lo:8:kworker.0 00000004:00080000:1.0:1787365111.330871:0:14414:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787365111.332061:0:14414:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 557561272383ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787365111.337662:0:14415:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787365111.337718:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14415:1874187714143488:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787365111.337844:0:14415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.337888:0:14415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0553d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.337920:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365111.337934:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714143360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365111.337965:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.338003:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714143488 00000100:00100000:3.0:1787365111.338012:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714143488 00000100:00080000:1.0:1787365111.338113:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365111.338120:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787365111.338132:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14415:x1874187714143488:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787365111.338952:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714143360 00000100:00100000:1.0:1787365111.338961:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714143360 00000100:00100000:1.0:1787365111.339002:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365111.339011:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714143360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365111.339047:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365111.339125:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874187714143360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.339130:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:3.0:1787365111.347123:0:15075:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787365111.347145:0:15075:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787365111.347156:0:15075:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00080000:3.0:1787365111.365248:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6c04b37800 x1874187714143360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365111.365287:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714143360:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1787365111.366284:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.366298:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366319:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.366325:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.366334:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366358:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366370:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366379:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366425:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365111.366459:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365111.366467:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366476:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365111.366481:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366492:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366512:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366522:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e1b40b9/0xcfc9272e5fc2c16c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.366549:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.366551:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.366553:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.367242:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.367251:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367266:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.367279:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.367286:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367299:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367308:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367316:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367339:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365111.367354:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365111.367360:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367368:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365111.367373:0:15561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367382:0:15561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367394:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367415:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8848e23/0xcfc9272e5fc2c173 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367448:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.367450:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.367451:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.367927:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.367935:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367946:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.367950:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.367954:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367964:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367972:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367979:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.367999:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365111.368011:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365111.368022:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.372093:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365111.372103:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.372121:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.372150:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.372160:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c084b015/0xcfc9272e5fc2c17a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.372193:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.372195:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.372198:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.373373:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.373386:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.373406:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.373411:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.373420:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.373462:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.373474:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.373485:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.373517:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787365111.374196:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365111.374209:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.374224:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365111.374230:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.374243:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.374274:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.374283:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063bdbf14/0xcfc9272e5fc2c181 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.374317:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.374319:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.374321:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.375080:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.375089:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.375104:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.375109:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.375116:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.375129:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.375141:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.375163:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.375192:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787365111.375540:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365111.375549:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.375558:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365111.375569:0:15561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.375580:0:15561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.375595:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.375603:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6f67b5d/0xcfc9272e5fc2c188 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.375625:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.375627:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.375629:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.381276:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.381297:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.381319:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.381325:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.381333:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.381498:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.381514:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.381523:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.381590:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365111.382318:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.382326:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.382513:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.382518:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.382524:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.382536:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.382546:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.382554:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388545:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365111.388564:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388582:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365111.388588:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388614:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388650:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388660:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024791516/0xcfc9272e5fc2c18f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388710:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365111.388715:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388723:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365111.388726:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388734:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388745:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.388753:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365111.388754:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365111.388762:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.402629:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365111.402654:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cbf75c3/0xcfc9272e5fc2c196 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.404062:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.405144:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.405161:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.405184:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.405189:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.405197:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.405230:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.405243:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.405252:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.405595:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365111.408050:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.408068:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.408090:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.408095:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.408103:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.408120:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.408132:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.408157:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787365111.411557:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787365111.411971:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365111.411987:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.412004:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c9800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365111.412011:0:15561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.412025:0:15561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.412053:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.412063:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003299fb4b/0xcfc9272e5fc2c19d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.412180:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365111.412187:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.412219:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878000 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787365111.412222:0:15561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.412231:0:15561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.412247:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.412258:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.412259:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.412261:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.412362:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365111.412372:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787365111.417635:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365111.417661:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.417689:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1787365111.417695:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365111.418605:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.418631:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.418646:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.418669:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.420251:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365111.420271:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.420289:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449400 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365111.420294:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.420319:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.420354:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.421524:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.421532:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.421536:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.422225:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787365111.422243:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e073fb35/0xcfc9272e5fc2c1ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365111.429388:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.429409:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.429593:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.430649:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.430655:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.430666:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.430688:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.430703:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.430712:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.430759:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365111.431635:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.431644:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.431657:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.431661:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.431666:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.431677:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.431685:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.431694:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.431721:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787365111.431739:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787365111.431748:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.431757:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878000 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365111.431769:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.431782:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.432531:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.432539:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5853b1d/0xcfc9272e5fc2c1b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.432559:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365111.432563:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.432571:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365111.432575:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.432582:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.432591:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.432598:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a4a8fa9/0xcfc9272e5fc2c1b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.432618:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.432620:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.432623:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365111.434574:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.436368:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.436386:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.436409:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.436496:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.436505:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.436525:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.436538:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.436545:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.436720:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365111.437523:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.437531:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.437557:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.437561:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.437567:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.437579:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.437588:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.437596:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441632:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365111.441653:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441673:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365111.441679:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441691:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441718:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441727:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c1c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441773:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365111.441777:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441804:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365111.441807:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441825:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441836:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.441845:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365111.441846:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365111.441848:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.442052:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365111.442062:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069efeef/0xcfc9272e5fc2c1c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365111.445022:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.445039:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.445060:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.445066:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.445076:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.445107:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.445119:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.445127:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.445203:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365111.445213:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.445223:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787365111.445228:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.445239:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.445275:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.445287:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.445289:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.445291:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.445353:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365111.445359:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5ee6b24/0xcfc9272e5fc2c1ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.445506:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.446201:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.446209:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.446224:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.446227:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.446232:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.446244:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.446266:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.446273:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.446341:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365111.447007:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.447016:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.447027:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.447032:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.447037:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.447048:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.447055:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.447062:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447356:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365111.447368:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447378:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787365111.447385:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447396:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447536:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447547:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a9c38da/0xcfc9272e5fc2c1d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447575:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365111.447579:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447594:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787365111.447597:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447606:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447618:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.447627:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.447629:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.447631:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.450557:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365111.450584:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073be5e6d/0xcfc9272e5fc2c1dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.450910:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.451760:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.451772:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.451890:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.451896:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.451904:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.451922:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.451933:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.451942:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.451965:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365111.452506:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.452513:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.452533:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.452537:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.452542:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.452552:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.452560:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.452568:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.452592:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787365111.452941:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365111.452953:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.452962:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879400 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787365111.452968:0:15561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.452978:0:15561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.453000:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.453017:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0332fdc/0xcfc9272e5fc2c1e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.453041:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365111.453045:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.453052:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787365111.453055:0:15561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.453063:0:15561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.453073:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.453080:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a502226/0xcfc9272e5fc2c1ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.453092:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.453094:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.453096:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.453373:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.453379:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.453389:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.453392:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.453397:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.453408:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.454559:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.454567:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.454594:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365111.454616:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365111.454622:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.454631:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365111.454636:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.454647:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.454665:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.454674:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e29ad876/0xcfc9272e5fc2c1f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.454702:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.454711:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.454713:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.456767:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.457004:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.457029:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.457035:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.457044:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.457063:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.457077:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.457087:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.457125:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365111.457745:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.457752:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.457765:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.457769:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.457774:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.458041:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365111.458052:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.458063:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365111.458069:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.458081:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.458104:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.458113:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa1b58c5/0xcfc9272e5fc2c1f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.458141:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.458151:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.458154:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.458213:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.458225:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.458235:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.458358:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365111.459061:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.459070:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.459084:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.459090:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.459096:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.459108:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.459118:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.459138:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.462860:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787365111.462882:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.462901:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40878200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365111.462907:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.462920:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.462947:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.462955:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b1ca46c/0xcfc9272e5fc2c1ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.462986:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365111.462991:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.462997:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40879c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365111.463000:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.463021:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.463031:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.463039:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.463040:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.463042:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365111.467540:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.469021:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365111.469043:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a84520/0xcfc9272e5fc2c206 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365111.472117:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.472137:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.472161:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.472167:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.472176:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.472194:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.472206:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.472215:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.472354:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365111.472365:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.472375:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365111.472381:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.472392:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.474095:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.474125:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.474128:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365111.474131:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.474384:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365111.474392:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6080385/0xcfc9272e5fc2c20d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365111.475559:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.475571:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475590:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.475596:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.475604:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475621:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475632:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475639:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475667:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365111.475683:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365111.475690:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475706:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030400 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365111.475711:0:15561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475721:0:15561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475739:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475747:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000010daa5e/0xcfc9272e5fc2c214 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.475766:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.475768:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.475770:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.475925:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.476577:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.476586:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476601:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.476605:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.476610:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476622:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476638:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476645:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476666:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365111.476678:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365111.476684:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476691:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030200 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365111.476695:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476704:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476717:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476725:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ddfe6d/0xcfc9272e5fc2c21b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.476741:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.476748:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365111.476751:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365111.477569:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365111.477578:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.477591:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1787365111.477595:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365111.477601:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.477611:0:15075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.477620:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.477628:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.477724:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787365111.479678:0:15075:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787365111.479916:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14415:x1874187714143488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 141780us (142066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.479931:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787365111.480020:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14415:1874187714143488:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787365111.480041:0:14415:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787365111.480118:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14415:1874187714143616:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787365111.480165:0:14415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.480230:0:14415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0553d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.480256:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714143616 00000100:00100000:3.0:1787365111.480264:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714143616 00000100:00100000:3.0:1787365111.480321:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365111.480332:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14415:x1874187714143616:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787365111.480392:0:15074:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1787365111.482543:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365111.482564:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.482580:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030a00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365111.482586:0:15561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.482614:0:15561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.482643:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.482651:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b079e470/0xcfc9272e5fc2c222 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.482772:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.482775:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365111.482800:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365111.505391:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14415:x1874187714143616:12345-0@lo:5:osp-pre-1-0.0 Request processed in 25043us (25208us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787365111.505974:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14415:1874187714143616:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787365111.505999:0:14415:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787365111.507068:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787365112.083256:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365113.101294:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787365113.363239:0:16151:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg402-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787365114.123109:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365115.153941:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365115.625547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365115.626043:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688978176 00000100:00100000:1.0:1787365115.626058:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688978176 00000100:00100000:1.0:1787365115.626121:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 75 00000100:00100000:1.0:1787365115.626131:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2363:x1874187688978176:12345-192.168.204.2@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787365115.626172:0:14385:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from aafc759a-56d4-42f5-b653-14dd754db9dc@192.168.204.2@tcp t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:1.0:1787365115.626231:0:14385:0:(genops.c:1385:class_connect()) connect: client aafc759a-56d4-42f5-b653-14dd754db9dc, cookie 0xcfc9272e5fc2c229 00000100:00080000:1.0:1787365115.626426:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9b6c05f9f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365115.626520:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+5:2363:x1874187688978176:12345-192.168.204.2@tcp:250:mount.lustre.0 Request processed in 389us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365115.626529:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 75 00000100:00100000:2.0:1787365115.641667:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.641741:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688978304 00000100:00100000:2.0:1787365115.641753:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688978304 00000100:00100000:2.0:1787365115.641829:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 76 00000100:00100000:2.0:1787365115.641840:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+5:13764:x1874187688978304:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787365115.641864:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365115.642310:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34448600/0xcfc9272e5fc2c230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67df08 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365115.642361:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34448600/0xcfc9272e5fc2c230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df08 expref: 6 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365115.642374:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34448600/0xcfc9272e5fc2c230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df08 expref: 6 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365115.642387:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448600, rc 0) 00000100:00100000:2.0:1787365115.642468:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+6:13764:x1874187688978304:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 629us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.642477:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 76 00000100:00100000:2.0:1787365115.650088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.652373:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688978432 00000100:00100000:2.0:1787365115.652393:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688978432 00000100:00100000:2.0:1787365115.652474:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 77 00000100:00100000:2.0:1787365115.652487:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+6:13764:x1874187688978432:12345-192.168.204.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787365115.657201:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+6:13764:x1874187688978432:12345-192.168.204.2@tcp:501:mount.lustre.0 Request processed in 4694us (7325us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787365115.657223:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 77 00000100:00100000:2.0:1787365115.662956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365115.666454:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688978560 00000100:00100000:0.0:1787365115.666477:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688978560 00000100:00100000:0.0:1787365115.666562:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 78 00000100:00100000:0.0:1787365115.666575:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+6:13764:x1874187688978560:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787365115.666599:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365115.666623:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e4c00/0xcfc9272e5fc2c237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67df0f expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.666662:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e4c00/0xcfc9272e5fc2c237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df0f expref: 7 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.666676:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e4c00/0xcfc9272e5fc2c237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df0f expref: 7 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.666707:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4c00, rc 0) 00000100:00100000:0.0:1787365115.666819:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+7:13764:x1874187688978560:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 246us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.666827:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 78 00000100:00100000:2.0:1787365115.669322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.669379:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688978688 00000100:00100000:2.0:1787365115.669391:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688978688 00000100:00100000:2.0:1787365115.669448:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 79 00000100:00100000:2.0:1787365115.669459:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+7:13764:x1874187688978688:12345-192.168.204.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787365115.670513:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+8:13764:x1874187688978688:12345-192.168.204.2@tcp:501:mount.lustre.0 Request processed in 1045us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.670527:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 79 00000100:00100000:2.0:1787365115.675657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365115.676125:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688978816 00000100:00100000:1.0:1787365115.676139:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688978816 00000100:00100000:1.0:1787365115.676246:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 80 00000100:00100000:1.0:1787365115.676259:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+8:13764:x1874187688978816:12345-192.168.204.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787365115.677674:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+8:13764:x1874187688978816:12345-192.168.204.2@tcp:503:mount.lustre.0 Request processed in 1346us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365115.677690:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 80 00000100:00100000:2.0:1787365115.685301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365115.685380:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688978944 00000100:00100000:3.0:1787365115.685394:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688978944 00000100:00100000:3.0:1787365115.685470:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 81 00000100:00100000:3.0:1787365115.685482:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+8:13782:x1874187688978944:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365115.686138:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+8:13782:x1874187688978944:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 654us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365115.686150:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 81 00000100:00100000:2.0:1787365115.695747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365115.695853:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688979072 00000100:00100000:1.0:1787365115.695866:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688979072 00000100:00100000:1.0:1787365115.695944:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 82 00000100:00100000:1.0:1787365115.695958:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+8:13782:x1874187688979072:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787365115.696507:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+8:13782:x1874187688979072:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 549us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365115.696529:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 82 00000100:00100000:2.0:1787365115.703454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365115.703567:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688979200 00000100:00100000:3.0:1787365115.703580:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688979200 00000100:00100000:3.0:1787365115.703653:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 83 00000100:00100000:3.0:1787365115.703676:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+8:13764:x1874187688979200:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787365115.703700:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365115.703750:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00030400/0xcfc9272e5fc2c23e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67df39 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365115.703824:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030400/0xcfc9272e5fc2c23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df39 expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365115.703839:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00030400/0xcfc9272e5fc2c23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df39 expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365115.703851:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030400, rc 0) 00000100:00100000:2.0:1787365115.704022:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+9:13764:x1874187688979200:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 355us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.704031:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 83 00000100:00100000:3.0:1787365115.716244:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.716429:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688979328 00000100:00100000:2.0:1787365115.716445:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688979328 00000100:00100000:2.0:1787365115.716532:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 84 00000100:00100000:2.0:1787365115.716546:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+9:13764:x1874187688979328:12345-192.168.204.2@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787365115.716583:0:14384:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787365115.716875:0:14384:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787365115.716883:0:14384:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787365115.716886:0:14384:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787365115.716889:0:14384:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787365115.721137:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+9:13764:x1874187688979328:12345-192.168.204.2@tcp:256:mount.lustre.0 Request processed in 4575us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.721160:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 84 00000100:00100000:1.0:1787365115.729255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.729460:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688979456 00000100:00100000:2.0:1787365115.729478:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688979456 00000100:00100000:2.0:1787365115.729566:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 85 00000100:00100000:2.0:1787365115.729578:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+9:13764:x1874187688979456:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787365115.729606:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365115.729641:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67df40 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365115.729694:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365115.729708:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365115.729719:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448400, rc 0) 00000100:00100000:2.0:1787365115.729847:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13764:x1874187688979456:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 271us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.729855:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 85 00000100:00100000:3.0:1787365115.733747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.733851:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688979584 00000100:00100000:2.0:1787365115.733866:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688979584 00000100:00100000:2.0:1787365115.733955:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 86 00000100:00100000:2.0:1787365115.733968:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13764:x1874187688979584:12345-192.168.204.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787365115.734637:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13764:x1874187688979584:12345-192.168.204.2@tcp:501:mount.lustre.0 Request processed in 669us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.734648:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 86 00000100:00100000:0.0:1787365115.740199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.740303:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688979712 00000100:00100000:2.0:1787365115.740317:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688979712 00000100:00100000:2.0:1787365115.740402:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 87 00000100:00100000:2.0:1787365115.740437:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13764:x1874187688979712:12345-192.168.204.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787365115.741974:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13764:x1874187688979712:12345-192.168.204.2@tcp:503:mount.lustre.0 Request processed in 1524us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.741988:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 87 00000100:00100000:1.0:1787365115.745145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.745420:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688979840 00000100:00100000:2.0:1787365115.745434:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688979840 00000100:00100000:2.0:1787365115.745506:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 88 00000100:00100000:2.0:1787365115.745518:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13787:x1874187688979840:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787365115.746732:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13787:x1874187688979840:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 1205us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.746746:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 88 00000100:00100000:2.0:1787365115.749513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365115.749623:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688979968 00000100:00100000:0.0:1787365115.749636:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688979968 00000100:00100000:0.0:1787365115.749746:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 89 00000100:00100000:0.0:1787365115.749757:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13787:x1874187688979968:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787365115.750117:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13787:x1874187688979968:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 361us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.750126:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 89 00000100:00100000:0.0:1787365115.769049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.769160:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688980096 00000100:00100000:2.0:1787365115.769174:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688980096 00000100:00100000:2.0:1787365115.769242:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:2.0:1787365115.769252:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2363:x1874187688980096:12345-192.168.204.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787365115.769303:0:14392:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d7f027af-e21f-4925-9029-fcde5f8f5a2f@192.168.204.2@tcp t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:2.0:1787365115.769381:0:14392:0:(genops.c:1385:class_connect()) connect: client d7f027af-e21f-4925-9029-fcde5f8f5a2f, cookie 0xcfc9272e5fc2c24c 00000004:00100000:2.0:1787365115.769424:0:14392:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787365115.769432:0:14392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787365115.824037:0:14392:0:(import.c:65:import_set_state_nolock()) ffff9b6c010b1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365115.824156:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2363:x1874187688980096:12345-192.168.204.2@tcp:38:mount.lustre.0 Request processed in 54902us (55121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365115.824170:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:2.0:1787365115.836515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365115.836669:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688980352 00000100:00100000:3.0:1787365115.836684:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688980352 00000100:00100000:3.0:1787365115.836906:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00080000:1.0:1787365115.837039:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365115.837085:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:13764:x1874187688980352:12345-192.168.204.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787365115.837150:0:14390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787365115.837310:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:13764:x1874187688980352:12345-192.168.204.2@tcp:41:mount.lustre.0 Request processed in 393us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.837319:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:2.0:1787365115.842982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365115.844009:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688980480 00000100:00100000:3.0:1787365115.844024:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688980480 00000100:00100000:3.0:1787365115.844110:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:3.0:1787365115.844123:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:13764:x1874187688980480:12345-192.168.204.2@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787365115.844979:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:13764:x1874187688980480:12345-192.168.204.2@tcp:40:mount.lustre.0 Request processed in 854us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365115.844991:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:2.0:1787365115.845411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365115.845689:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688980224 00000100:00100000:3.0:1787365115.845698:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688980224 00000100:00100000:3.0:1787365115.845874:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:3.0:1787365115.845904:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:0:x1874187688980224:12345-192.168.204.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787365115.845938:0:14391:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787365115.846024:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:0:x1874187688980224:12345-192.168.204.2@tcp:41:mount.lustre.0 Request processed in 122us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365115.846031:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787365115.848513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365115.848736:0:15807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688980608 00000100:00100000:2.0:1787365115.848751:0:15807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688980608 00000100:00100000:2.0:1787365115.848896:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:2.0:1787365115.848907:0:15807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2363:x1874187688980608:12345-192.168.204.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787365115.848948:0:15807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d7f027af-e21f-4925-9029-fcde5f8f5a2f@192.168.204.2@tcp t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1787365115.849003:0:15807:0:(genops.c:1385:class_connect()) connect: client d7f027af-e21f-4925-9029-fcde5f8f5a2f, cookie 0xcfc9272e5fc2c253 00002000:00100000:2.0:1787365115.849019:0:15807:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d7f027af-e21f-4925-9029-fcde5f8f5a2f/ffff9b6d2026d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787365115.849050:0:15807:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787365115.849925:0:15807:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787365115.850031:0:15807:0:(import.c:65:import_set_state_nolock()) ffff9b6d2026e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365115.850147:0:15807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2363:x1874187688980608:12345-192.168.204.2@tcp:8:mount.lustre.0 Request processed in 1239us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.850158:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:0.0:1787365115.854003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365115.854125:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688980736 00000100:00100000:1.0:1787365115.854137:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688980736 00000100:00100000:1.0:1787365115.854264:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:1.0:1787365115.854275:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1874187688980736:12345-192.168.204.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787365115.854320:0:15075:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d7f027af-e21f-4925-9029-fcde5f8f5a2f@192.168.204.2@tcp t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:1.0:1787365115.854391:0:15075:0:(genops.c:1385:class_connect()) connect: client d7f027af-e21f-4925-9029-fcde5f8f5a2f, cookie 0xcfc9272e5fc2c25a 00002000:00100000:1.0:1787365115.854410:0:15075:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d7f027af-e21f-4925-9029-fcde5f8f5a2f/ffff9b6c05f98800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787365115.854446:0:15075:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787365115.855384:0:15075:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787365115.855438:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9b6c05f9a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365115.856532:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2363:x1874187688980736:12345-192.168.204.2@tcp:8:mount.lustre.0 Request processed in 2246us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365115.856547:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:2.0:1787365115.856770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365115.857694:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688980864 00000100:00100000:3.0:1787365115.857772:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688980864 00000100:00100000:1.0:1787365115.858081:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:1.0:1787365115.858097:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:13764:x1874187688980864:12345-192.168.204.2@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787365115.859529:0:14393:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1278us 00000004:00200000:0.0:1787365115.880772:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787365115.881177:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:13764:x1874187688980864:12345-192.168.204.2@tcp:33:mount.lustre.0 Request processed in 23072us (24398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.881213:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:1.0:1787365115.917916:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714143744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365115.918035:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365115.918147:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714143744 00000100:00100000:1.0:1787365115.918157:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714143744 00000100:00100000:1.0:1787365115.918247:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787365115.919484:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714143744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365115.919529:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365115.919641:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714143744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1385us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365115.919651:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787365115.919691:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365115.922018:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714143744:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787365116.005242:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7f027af-e21f-4925-9029-fcde5f8f5a2f 00000100:00100000:2.0:1787365116.078437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365116.078606:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688980992 00000100:00100000:3.0:1787365116.078622:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688980992 00000100:00100000:3.0:1787365116.078712:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:3.0:1787365116.078725:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:13808:x1874187688980992:12345-192.168.204.2@tcp:101:mkdir.0 00010000:00010000:3.0:1787365116.078759:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365116.078856:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2c261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67df6a expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365116.078967:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c268 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365116.078986:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365116.079003:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365116.079292:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787365116.079297:0:14392:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365116.079497:0:14392:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365116.079549:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030200/0xcfc9272e5fc2c261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df6a expref: 8 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365116.079573:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c268 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df6a expref: 7 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365116.079583:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:3.0:1787365116.079587:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365116.079591:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031e00, rc 0) 00000100:00100000:3.0:1787365116.079674:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:13808:x1874187688980992:12345-192.168.204.2@tcp:101:mkdir.0 Request processed in 952us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365116.079683:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 8 00010000:00010000:0.0:1787365116.172501:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365116.430600:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714144256:0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.430725:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365116.430859:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365116.430866:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714144128:0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.430894:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365116.430935:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714144256 00000100:00100000:3.0:1787365116.430946:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714144256 00000100:00100000:3.0:1787365116.431024:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714144128 00000100:00100000:3.0:1787365116.431028:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714144128 00000100:00100000:3.0:1787365116.431049:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787365116.431060:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714144256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.431125:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714144256:12345-0@lo:400:kworker.0 Request processed in 68us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365116.431133:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787365116.431175:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787365116.431182:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714144128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.431216:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874187714144128:12345-0@lo:400:kworker.0 Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365116.431223:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787365116.431275:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874187714144128:0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.431288:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714144256:0@lo:400:kworker.0 00000100:00080000:3.0:1787365116.431352:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365116.432676:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714143872:0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.432773:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365116.432873:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714144384:0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.432906:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365116.432944:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365116.432951:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714144000:0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.432981:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365116.433023:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714144384 00000100:00100000:2.0:1787365116.433031:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714144384 00000100:00100000:3.0:1787365116.433086:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714143872 00000100:00100000:3.0:1787365116.433091:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714143872 00000100:00100000:2.0:1787365116.433092:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365116.433101:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714144384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.433131:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787365116.433137:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3315:x1874187714143872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.433179:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3315:x1874187714143872:12345-0@lo:400:kworker.0 Request processed in 42us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365116.433192:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787365116.433250:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365116.433410:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714144512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365116.433446:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365116.433489:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714144512 00000100:00100000:1.0:1787365116.433493:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714144512 00000100:00100000:1.0:1787365116.433532:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365116.433539:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874187714144512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365116.433561:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365116.433606:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874187714144512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365116.433613:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365116.433684:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1874187714144512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365116.433731:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714144000 00000100:00100000:1.0:1787365116.433735:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714144000 00000100:00100000:1.0:1787365116.433761:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365116.433768:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714144000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.437362:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714144384:12345-0@lo:400:kworker.0 Request processed in 4245us (4438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365116.437384:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787365116.437986:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365116.439839:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714143872:0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.447947:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714144384:0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.453803:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1874187714144000:12345-0@lo:400:kworker.0 Request processed in 19995us (20781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365116.453823:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365116.461811:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714144000:0@lo:400:kworker.0 00000001:00100000:3.0:1787365116.548595:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787365116.548621:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d7f027af-e21f-4925-9029-fcde5f8f5a2f 00000001:00080000:3.0:1787365116.548637:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1787365117.196727:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365118.217450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.217744:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688981120 00000100:00100000:3.0:1787365118.217768:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688981120 00000100:00100000:3.0:1787365118.217921:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:3.0:1787365118.217936:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:13860:x1874187688981120:12345-192.168.204.2@tcp:41:lfs.0 00000004:00000024:3.0:1787365118.218004:0:14392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787365118.218149:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:13860:x1874187688981120:12345-192.168.204.2@tcp:41:lfs.0 Request processed in 217us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.218157:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00080000:2.0:1787365118.218735:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787365118.220081:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365118.225870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365118.226024:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688981248 00000100:00100000:1.0:1787365118.226042:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688981248 00000100:00100000:1.0:1787365118.226157:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:1.0:1787365118.226170:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:13860:x1874187688981248:12345-192.168.204.2@tcp:13:lfs.0 00002000:00000024:1.0:1787365118.226226:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365118.226377:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:13860:x1874187688981248:12345-192.168.204.2@tcp:13:lfs.0 Request processed in 209us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365118.226385:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00080000:2.0:1787365118.229574:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365118.230729:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365118.231044:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688981376 00000100:00100000:2.0:1787365118.231060:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688981376 00000100:00100000:2.0:1787365118.231156:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:2.0:1787365118.231172:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:13860:x1874187688981376:12345-192.168.204.2@tcp:13:lfs.0 00002000:00000024:2.0:1787365118.231237:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365118.231400:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:13860:x1874187688981376:12345-192.168.204.2@tcp:13:lfs.0 Request processed in 223us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365118.231408:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00080000:3.0:1787365118.231491:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365118.436575:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365118.437133:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688981504 00000100:00100000:2.0:1787365118.437149:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688981504 00000100:00100000:2.0:1787365118.437240:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 91 00000100:00100000:2.0:1787365118.437254:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+10:13894:x1874187688981504:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787365118.437278:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365118.437316:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34448200/0xcfc9272e5fc2c26f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67df71 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365118.437362:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34448200/0xcfc9272e5fc2c26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df71 expref: 11 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365118.437399:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34448200/0xcfc9272e5fc2c26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df71 expref: 11 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365118.437411:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448200, rc 0) 00000100:00100000:2.0:1787365118.437502:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13894:x1874187688981504:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 251us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365118.437510:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 91 00000100:00100000:0.0:1787365118.456204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365118.458833:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688981632 00000100:00100000:1.0:1787365118.458856:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688981632 00000100:00100000:1.0:1787365118.458973:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 92 00000100:00100000:1.0:1787365118.458996:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13894:x1874187688981632:12345-192.168.204.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787365118.460863:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13894:x1874187688981632:12345-192.168.204.2@tcp:501:mount.lustre.0 Request processed in 1853us (4659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365118.460883:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 92 00000100:00100000:1.0:1787365118.473479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365118.473937:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688981760 00000100:00100000:0.0:1787365118.473951:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688981760 00000100:00100000:0.0:1787365118.474036:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 93 00000100:00100000:0.0:1787365118.474049:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13894:x1874187688981760:12345-192.168.204.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787365118.474459:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13894:x1874187688981760:12345-192.168.204.2@tcp:503:mount.lustre.0 Request processed in 411us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365118.474468:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 93 00000100:00100000:0.0:1787365118.493253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365118.495626:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688981888 00000100:00100000:2.0:1787365118.495647:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688981888 00000100:00100000:2.0:1787365118.495742:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 94 00000100:00100000:2.0:1787365118.495755:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13900:x1874187688981888:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787365118.497830:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13900:x1874187688981888:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 2060us (4580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365118.497848:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 94 00000100:00100000:2.0:1787365118.527066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365118.527186:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688982016 00000100:00100000:1.0:1787365118.527200:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688982016 00000100:00100000:1.0:1787365118.527273:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 95 00000100:00100000:1.0:1787365118.527286:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13900:x1874187688982016:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787365118.527627:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13900:x1874187688982016:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 343us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365118.527637:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 95 00000100:00100000:1.0:1787365118.537082:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.537472:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688982144 00000100:00100000:3.0:1787365118.537487:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688982144 00000100:00100000:3.0:1787365118.537572:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 96 00000100:00100000:3.0:1787365118.537585:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13894:x1874187688982144:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787365118.537615:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365118.537642:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2c276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67df9b expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.537680:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2c276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df9b expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.537693:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00030200/0xcfc9272e5fc2c276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df9b expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.537704:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00030200, rc 0) 00000100:00100000:3.0:1787365118.537830:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13894:x1874187688982144:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 248us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.537838:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 96 00000100:00100000:0.0:1787365118.541003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.541125:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688982272 00000100:00100000:3.0:1787365118.541137:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688982272 00000100:00100000:3.0:1787365118.541202:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 97 00000100:00100000:3.0:1787365118.541231:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13894:x1874187688982272:12345-192.168.204.2@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787365118.541263:0:14384:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787365118.541302:0:14384:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787365118.541312:0:14384:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787365118.541316:0:14384:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787365118.541319:0:14384:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787365118.543105:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13894:x1874187688982272:12345-192.168.204.2@tcp:256:mount.lustre.0 Request processed in 1884us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.543121:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 97 00000100:00100000:1.0:1787365118.549154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365118.549663:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688982400 00000100:00100000:0.0:1787365118.549677:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688982400 00000100:00100000:0.0:1787365118.549857:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 98 00000100:00100000:0.0:1787365118.549871:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13894:x1874187688982400:12345-192.168.204.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787365118.549899:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365118.549926:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dfa2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365118.549966:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 13 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365118.549979:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 13 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365118.550009:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4400, rc 0) 00000100:00100000:0.0:1787365118.550083:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13894:x1874187688982400:12345-192.168.204.2@tcp:101:mount.lustre.0 Request processed in 215us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365118.550091:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 98 00000100:00100000:2.0:1787365118.552527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.552660:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688982528 00000100:00100000:3.0:1787365118.552673:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688982528 00000100:00100000:3.0:1787365118.552746:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 99 00000100:00100000:3.0:1787365118.552758:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13894:x1874187688982528:12345-192.168.204.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787365118.553219:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13894:x1874187688982528:12345-192.168.204.2@tcp:501:mount.lustre.0 Request processed in 462us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.553228:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 99 00000100:00100000:1.0:1787365118.555960:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.556068:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688982656 00000100:00100000:3.0:1787365118.556082:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688982656 00000100:00100000:3.0:1787365118.556154:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 100 00000100:00100000:3.0:1787365118.556166:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13894:x1874187688982656:12345-192.168.204.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787365118.556519:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13894:x1874187688982656:12345-192.168.204.2@tcp:503:mount.lustre.0 Request processed in 355us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.556530:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 100 00000100:00100000:2.0:1787365118.561945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.562361:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688982784 00000100:00100000:3.0:1787365118.562377:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688982784 00000100:00100000:3.0:1787365118.562472:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 101 00000100:00100000:3.0:1787365118.562485:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13904:x1874187688982784:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365118.563138:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13904:x1874187688982784:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 652us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.563162:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 101 00000100:00100000:2.0:1787365118.573425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365118.573594:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688982912 00000100:00100000:0.0:1787365118.573609:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688982912 00000100:00100000:0.0:1787365118.573687:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 102 00000100:00100000:0.0:1787365118.573700:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13904:x1874187688982912:12345-192.168.204.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787365118.574096:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13904:x1874187688982912:12345-192.168.204.2@tcp:502:llog_process_th.0 Request processed in 399us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365118.574105:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 102 00000100:00100000:1.0:1787365118.589863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365118.590043:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688983040 00000100:00100000:2.0:1787365118.590058:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688983040 00000100:00100000:2.0:1787365118.590121:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:2.0:1787365118.590132:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2363:x1874187688983040:12345-192.168.204.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787365118.590177:0:14391:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6b87453e-debf-4f7b-9b54-26b3375a65eb@192.168.204.2@tcp t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:2.0:1787365118.590231:0:14391:0:(genops.c:1385:class_connect()) connect: client 6b87453e-debf-4f7b-9b54-26b3375a65eb, cookie 0xcfc9272e5fc2c284 00000004:00100000:2.0:1787365118.590380:0:14391:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787365118.591723:0:14391:0:(import.c:65:import_set_state_nolock()) ffff9b6c06f85800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365118.591869:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2363:x1874187688983040:12345-192.168.204.2@tcp:38:mount.lustre.0 Request processed in 1733us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365118.591881:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:2.0:1787365118.616603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365118.616723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.617382:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688983168 00000100:00100000:3.0:1787365118.617866:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688983168 00000100:00100000:3.0:1787365118.617989:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688983296 00000100:00100000:3.0:1787365118.617994:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688983296 00000100:00100000:3.0:1787365118.618024:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:3.0:1787365118.618037:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+7:0:x1874187688983168:12345-192.168.204.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787365118.618088:0:14392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787365118.618199:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+7:0:x1874187688983168:12345-192.168.204.2@tcp:41:mount.lustre.0 Request processed in 164us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.618208:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:3.0:1787365118.618231:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:3.0:1787365118.618240:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:13894:x1874187688983296:12345-192.168.204.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787365118.618252:0:14392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787365118.619528:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365118.619623:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:13894:x1874187688983296:12345-192.168.204.2@tcp:41:mount.lustre.0 Request processed in 1139us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.619638:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:2.0:1787365118.623503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365118.624221:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688983424 00000100:00100000:0.0:1787365118.624237:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688983424 00000100:00100000:0.0:1787365118.624337:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:0.0:1787365118.624349:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:13894:x1874187688983424:12345-192.168.204.2@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787365118.624752:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:13894:x1874187688983424:12345-192.168.204.2@tcp:40:mount.lustre.0 Request processed in 404us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365118.624762:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:0.0:1787365118.628109:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365118.628236:0:15807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688983552 00000100:00100000:2.0:1787365118.628250:0:15807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688983552 00000100:00100000:2.0:1787365118.628330:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:2.0:1787365118.628340:0:15807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2363:x1874187688983552:12345-192.168.204.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787365118.628620:0:15807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6b87453e-debf-4f7b-9b54-26b3375a65eb@192.168.204.2@tcp t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:2.0:1787365118.628673:0:15807:0:(genops.c:1385:class_connect()) connect: client 6b87453e-debf-4f7b-9b54-26b3375a65eb, cookie 0xcfc9272e5fc2c28b 00002000:00100000:2.0:1787365118.628693:0:15807:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6b87453e-debf-4f7b-9b54-26b3375a65eb/ffff9b6d10983800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787365118.628709:0:15807:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787365118.629085:0:15807:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787365118.629133:0:15807:0:(import.c:65:import_set_state_nolock()) ffff9b6d10983000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365118.629251:0:15807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2363:x1874187688983552:12345-192.168.204.2@tcp:8:mount.lustre.0 Request processed in 909us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365118.629260:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:2.0:1787365118.632740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.632890:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688983680 00000100:00100000:3.0:1787365118.632904:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688983680 00000100:00100000:3.0:1787365118.632973:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:3.0:1787365118.632985:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2363:x1874187688983680:12345-192.168.204.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787365118.633033:0:15074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6b87453e-debf-4f7b-9b54-26b3375a65eb@192.168.204.2@tcp t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:3.0:1787365118.633080:0:15074:0:(genops.c:1385:class_connect()) connect: client 6b87453e-debf-4f7b-9b54-26b3375a65eb, cookie 0xcfc9272e5fc2c292 00002000:00100000:3.0:1787365118.633096:0:15074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6b87453e-debf-4f7b-9b54-26b3375a65eb/ffff9b6c010b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787365118.633125:0:15074:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787365118.633633:0:15074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787365118.633675:0:15074:0:(import.c:65:import_set_state_nolock()) ffff9b6c010b4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365118.633774:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2363:x1874187688983680:12345-192.168.204.2@tcp:8:mount.lustre.0 Request processed in 789us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.633828:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:0.0:1787365118.636702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365118.636933:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688983808 00000100:00100000:2.0:1787365118.636948:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688983808 00000100:00100000:2.0:1787365118.637025:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:2.0:1787365118.637037:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:13894:x1874187688983808:12345-192.168.204.2@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787365118.637503:0:14394:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787365118.637860:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:13894:x1874187688983808:12345-192.168.204.2@tcp:33:mount.lustre.0 Request processed in 821us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365118.637871:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 1 00000040:00080000:1.0:1787365118.732368:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787365118.869442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365118.869716:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688983936 00000100:00100000:3.0:1787365118.869738:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688983936 00000100:00100000:3.0:1787365118.869887:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:3.0:1787365118.869905:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:13925:x1874187688983936:12345-192.168.204.2@tcp:101:mkdir.0 00010000:00010000:3.0:1787365118.869930:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365118.869955:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2c299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dfcc expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.870033:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.870050:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.870063:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365118.870314:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787365118.870320:0:14392:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365118.870405:0:14392:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.870438:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031800/0xcfc9272e5fc2c299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 8 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.870467:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 7 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365118.870477:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:3.0:1787365118.870480:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365118.870483:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031600, rc 0) 00000100:00100000:3.0:1787365118.870560:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+7:13925:x1874187688983936:12345-192.168.204.2@tcp:101:mkdir.0 Request processed in 662us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365118.870569:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00010000:00010000:0.0:1787365119.244765:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365120.275724:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365121.036070:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787365121.036104:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c04b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714144640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365121.036220:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365121.036624:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714144640 00000100:00100000:3.0:1787365121.036634:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714144640 00000100:00100000:3.0:1787365121.036720:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365121.036733:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714144640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365121.036822:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365121.036891:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714144640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (671us total) trans 0 rc 0/0 00000100:00080000:2.0:1787365121.039128:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365121.047829:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365121.047975:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c04b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714144640:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787365121.134180:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6b87453e-debf-4f7b-9b54-26b3375a65eb 00000001:00100000:0.0:1787365121.134195:0:5878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d7f027af-e21f-4925-9029-fcde5f8f5a2f 00000001:00100000:1.0:1787365121.156181:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b87453e-debf-4f7b-9b54-26b3375a65eb 00010000:00010000:1.0:1787365121.294173:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365121.547487:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365121.547513:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714144768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365121.547589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365121.547656:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714144768 00000100:00100000:1.0:1787365121.547664:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714144768 00000100:00100000:1.0:1787365121.547728:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787365121.547737:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714144768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365121.547777:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365121.547843:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714144768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365121.547850:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787365121.547871:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365121.547895:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787365121.547917:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714144768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365121.553186:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714144896:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.553223:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714145024:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.553304:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365121.553325:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365121.553358:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714145152:0@lo:400:kworker.0 00000100:00100000:3.0:1787365121.553384:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714144896 00000100:00100000:2.0:1787365121.553389:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365121.553392:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714144896 00000100:00100000:2.0:1787365121.553411:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365121.553418:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714145280:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.553443:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365121.553452:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787365121.553465:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3315:x1874187714144896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.553477:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714145024 00000100:00100000:2.0:1787365121.553482:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714145024 00000100:00100000:2.0:1787365121.553510:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714145152 00000100:00100000:2.0:1787365121.553514:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714145152 00000100:00100000:2.0:1787365121.553540:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714145280 00000100:00100000:3.0:1787365121.553541:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3315:x1874187714144896:12345-0@lo:400:kworker.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365121.553544:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714145280 00000100:00100000:3.0:1787365121.553554:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787365121.553566:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787365121.553575:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714145024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365121.553616:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714144896:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.553624:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874187714145024:12345-0@lo:400:kworker.0 Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365121.553632:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787365121.553649:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787365121.553662:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714145152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.553770:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874187714145152:12345-0@lo:400:kworker.0 Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365121.553777:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787365121.553819:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787365121.553827:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714145280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365121.553840:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1874187714145152:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.553865:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874187714145280:12345-0@lo:400:kworker.0 Request processed in 38us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365121.553866:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1874187714145280:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.553880:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787365121.553910:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365121.553930:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874187714145024:0@lo:400:kworker.0 00000001:00100000:2.0:1787365121.603278:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b87453e-debf-4f7b-9b54-26b3375a65eb 00000001:02000400:0.0:1787365121.860497:0:16361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787365122.315295:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365123.344326:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365123.865051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365123.865110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365123.865515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365123.865584:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688984192 00000100:00100000:2.0:1787365123.865599:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688984192 00000100:00100000:2.0:1787365123.865702:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:2.0:1787365123.865715:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2367:x1874187688984192:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787365123.865877:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2367:x1874187688984192:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 165us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365123.865888:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00080000:3.0:1787365123.868538:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365123.869481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365123.869515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365123.870096:0:15807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688984448 00000100:00100000:1.0:1787365123.870111:0:15807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688984448 00000100:00100000:1.0:1787365123.870207:0:15807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688984704 00000100:00100000:1.0:1787365123.870211:0:15807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688984704 00000100:00100000:1.0:1787365123.870246:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:1.0:1787365123.870430:0:15807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2367:x1874187688984448:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365123.870547:0:15807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2367:x1874187688984448:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 123us (5436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365123.870555:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:1.0:1787365123.870576:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:1.0:1787365123.870583:0:15807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2367:x1874187688984704:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365123.870606:0:15807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2367:x1874187688984704:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 25us (5092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365123.870612:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:1.0:1787365123.870634:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688984064 00000100:00100000:1.0:1787365123.870638:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688984064 00000100:00100000:1.0:1787365123.870665:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 104 00000100:00100000:1.0:1787365123.870670:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+13:2367:x1874187688984064:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365123.870696:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+13:2367:x1874187688984064:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 26us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365123.870702:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 104 00000100:00080000:1.0:1787365123.870733:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787365123.870737:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365123.872863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365123.872923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365123.872968:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688984576 00000100:00100000:0.0:1787365123.872978:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688984576 00000100:00100000:0.0:1787365123.873051:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:0.0:1787365123.873062:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2367:x1874187688984576:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365123.873157:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2367:x1874187688984576:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365123.873165:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:0.0:1787365123.873204:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688984320 00000100:00100000:0.0:1787365123.873208:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688984320 00000100:00100000:0.0:1787365123.873235:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688984832 00000100:00100000:0.0:1787365123.873238:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688984832 00000100:00100000:0.0:1787365123.873255:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:0.0:1787365123.873263:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2367:x1874187688984320:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365123.873292:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2367:x1874187688984320:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 29us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365123.873298:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:0.0:1787365123.873309:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:0.0:1787365123.873315:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c074cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2367:x1874187688984832:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365123.873336:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c074cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2367:x1874187688984832:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 22us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365123.873349:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00080000:0.0:1787365123.873367:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787365123.873371:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787365123.873374:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787365124.374666:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365125.392951:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787365125.567515:0:16508:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebac80e40 20000000:00000080:3.0:1787365125.567533:0:16508:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d34495000 uarg=0000000000000000 20000000:01000000:3.0:1787365125.567567:0:16508:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787365125.567573:0:16508:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787365125.567578:0:16508:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787365125.570739:0:16509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787365125.571476:0:16508:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787365125.580580:0:16508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787365125.580616:0:16508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.580636:0:16508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 18 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.580643:0:16508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.580651:0:16508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.580678:0:16508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.580685:0:16508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.580692:0:16508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.580740:0:16508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.580755:0:16508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 12 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.580771:0:16508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145408:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787365125.581324:0:16508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.581337:0:16508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 12 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.581346:0:16508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145536:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787365125.581380:0:16508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.581388:0:16508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 18 pid: 14384 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.581411:0:16508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145664:0@lo:104: 00000100:00100000:3.0:1787365125.581454:0:16508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787365125.581499:0:16508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.581508:0:16508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 18 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.581516:0:16508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145792:0@lo:104: 00000100:00100000:3.0:1787365125.581539:0:16508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787365125.581561:0:16508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 18 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.581568:0:16508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 18 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.581576:0:16508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145920:0@lo:104: 00000100:00100000:3.0:1787365125.581599:0:16508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365125.581609:0:16508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11610900 going to sleep for 11 seconds 00000100:00100000:0.0:1787365125.581769:0:14374:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787365125.581814:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714145664 00000100:00100000:0.0:1787365125.581822:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714145664 00000100:00100000:0.0:1787365125.581864:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714145792 00000100:00100000:0.0:1787365125.581867:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714145792 00000100:00100000:0.0:1787365125.581878:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714145920 00000100:00100000:0.0:1787365125.581880:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714145920 00000100:00100000:0.0:1787365125.581894:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365125.581903:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+5:16508:x1874187714145664:12345-0@lo:104: 00010000:00010000:0.0:1787365125.581917:0:14374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.581984:0:14374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787365125.581990:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+5:16508:x1874187714145664:12345-0@lo:104: Request processed in 89us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365125.581998:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365125.582020:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365125.582027:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+4:16508:x1874187714145792:12345-0@lo:104: 00010000:00010000:0.0:1787365125.582034:0:14374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582067:0:14374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787365125.582073:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+4:16508:x1874187714145792:12345-0@lo:104: Request processed in 47us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365125.582085:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365125.582097:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365125.582102:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34582050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+3:16508:x1874187714145920:12345-0@lo:104: 00010000:00010000:0.0:1787365125.582109:0:14374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582161:0:14374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787365125.582166:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34582050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+3:16508:x1874187714145920:12345-0@lo:104: Request processed in 64us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365125.582172:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787365125.582216:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787365125.582222:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582229:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d013c9e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787365125.582233:0:15561:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582246:0:15561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365125.582255:0:15561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365125.582261:0:15561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365125.582293:0:15561:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582300:0:15561:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365125.582328:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582335:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d013c9e00/0xcfc9272e5fc2c11f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2c126 expref: -99 pid: 15794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582349:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365125.582352:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582358:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c0c00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787365125.582360:0:15561:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582367:0:15561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365125.582373:0:15561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365125.582378:0:15561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365125.582389:0:15561:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582395:0:15561:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365125.582400:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582406:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2bfe4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bfeb expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582423:0:15561:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365125.582426:0:15561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582432:0:15561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc1cfac20) 10000000:00010000:0.0:1787365125.582435:0:15561:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582441:0:15561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365125.582447:0:15561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365125.582452:0:15561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365125.582465:0:15561:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582470:0:15561:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365125.582485:0:15561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582491:0:15561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.102@tcp lock: ffff9b6d420c1e00/0xcfc9272e5fc2bf97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfc9272e5fc2bf9e expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582504:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365125.582506:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365125.582507:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365125.582513:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365125.582523:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365125.582541:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714146048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365125.582574:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365125.582596:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365125.582602:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c074cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714146176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365125.582623:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365125.582651:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb110b-5671-42a1-88c0-bbf646942aa8:3313:1874187714146304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365125.582674:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365125.582703:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714146048 00000100:00100000:0.0:1787365125.582707:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714146048 00010000:00010000:0.0:1787365125.582725:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 19 pid: 14384 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365125.582738:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714146176 00000100:00100000:0.0:1787365125.582740:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714146176 00010000:00010000:0.0:1787365125.582748:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 20 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365125.582757:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714146304 00000100:00100000:0.0:1787365125.582759:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714146304 00010000:00010000:0.0:1787365125.582767:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 21 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365125.582777:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365125.582782:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+21:3315:x1874187714146048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365125.582791:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365125.582829:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 21 pid: 14384 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582849:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 21 pid: 14384 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582865:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365125.582892:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+21:3315:x1874187714146048:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365125.582899:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365125.582912:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365125.582918:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+20:3315:x1874187714146176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365125.582925:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365125.582928:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 20 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582936:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 20 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.582944:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365125.582964:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+20:3315:x1874187714146176:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365125.582970:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365125.582981:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365125.582987:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d35505450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3313:x1874187714146304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365125.582993:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365125.582997:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 19 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.583005:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 19 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365125.583022:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365125.583048:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d35505450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3313:x1874187714146304:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365125.583055:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365125.583111:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb110b-5671-42a1-88c0-bbf646942aa8:3313:1874187714146304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365125.583132:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714146176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365125.583139:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c074cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714146048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787365125.584090:0:16508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c0200/0xcfc9272e5fc2c126 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2c11f expref: 18 pid: 14384 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.584115:0:16508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145664:0@lo:104: 00010000:00010000:3.0:1787365125.584126:0:16508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d420c1800/0xcfc9272e5fc2bfeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2bfe4 expref: 17 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.584133:0:16508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145792:0@lo:104: 00010000:00010000:3.0:1787365125.584456:0:16508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d34448c00/0xcfc9272e5fc2bf9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfc9272e5fc2bf97 expref: 16 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.584476:0:16508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145920:0@lo:104: 00000100:00100000:2.0:1787365125.589598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365125.589641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365125.589721:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688984960 00000100:00100000:1.0:1787365125.589732:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688984960 00010000:00010000:1.0:1787365125.589775:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 13 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365125.589841:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688985088 00000100:00100000:1.0:1787365125.589845:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688985088 00010000:00010000:1.0:1787365125.589860:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 14 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365125.589900:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787365125.589909:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafc759a-56d4-42f5-b653-14dd754db9dc+14:2366:x1874187688984960:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365125.589926:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365125.589932:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 14 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.589945:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 14 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.589968:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365125.590025:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafc759a-56d4-42f5-b653-14dd754db9dc+14:2366:x1874187688984960:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 116us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365125.590033:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787365125.590052:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:1.0:1787365125.590059:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:2364:x1874187688985088:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365125.590066:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365125.590071:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 13 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590079:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 13 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590091:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590115:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590148:0:14376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590165:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590172:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590179:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590185:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787365125.590189:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590196:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590204:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365125.590214:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365125.590237:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:2364:x1874187688985088:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 178us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365125.590243:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 8 00010000:00010000:3.0:1787365125.594885:0:16508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d342e4400/0xcfc9272e5fc2c27d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfa2 expref: 12 pid: 14385 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.594911:0:16508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145408:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787365125.594928:0:16508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d34448400/0xcfc9272e5fc2c245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df40 expref: 11 pid: 14383 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365125.594937:0:16508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16508:1874187714145536:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787365125.594980:0:16508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.594992:0:16508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.594998:0:16508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365125.595004:0:16508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2a7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365126.155736:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714146432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365126.157396:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365126.157523:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714146432 00000100:00100000:2.0:1787365126.157533:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714146432 00000100:00100000:2.0:1787365126.157592:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787365126.157603:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714146432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365126.157654:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365126.157708:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874187714146432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365126.157716:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787365126.159190:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365126.159990:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1874187714146432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787365126.414836:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365126.667194:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714146560:0@lo:400:kworker.0 00000100:00100000:1.0:1787365126.667267:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365126.667309:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714147072:0@lo:400:kworker.0 00000100:00100000:1.0:1787365126.667365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365126.667395:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714146944:0@lo:400:kworker.0 00000100:00100000:1.0:1787365126.667397:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365126.667408:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714146688:0@lo:400:kworker.0 00000100:00100000:1.0:1787365126.667445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365126.667451:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365126.667483:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714146816:0@lo:400:kworker.0 00000100:00100000:3.0:1787365126.667509:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714146560 00000100:00100000:1.0:1787365126.667513:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365126.667517:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714146560 00000100:00100000:1.0:1787365126.667552:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714147072 00000100:00100000:1.0:1787365126.667557:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714147072 00000100:00100000:3.0:1787365126.667568:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787365126.667579:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3315:x1874187714146560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365126.667598:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714146944 00000100:00100000:1.0:1787365126.667601:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714146944 00000100:00100000:1.0:1787365126.667622:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714146816 00000100:00100000:1.0:1787365126.667625:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714146816 00000100:00100000:3.0:1787365126.667633:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+16:3315:x1874187714146560:12345-0@lo:400:kworker.0 Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365126.667641:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787365126.667645:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787365126.667653:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714147072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365126.667683:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787365126.667692:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787365126.667697:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714147072:12345-0@lo:400:kworker.0 Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365126.667704:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787365126.667720:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787365126.667728:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714146944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365126.667768:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874187714146944:12345-0@lo:400:kworker.0 Request processed in 41us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365126.667776:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787365126.667816:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787365126.667824:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714146816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365126.667861:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714146816:12345-0@lo:400:kworker.0 Request processed in 38us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365126.667867:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787365126.667893:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714146688 00000100:00100000:1.0:1787365126.667897:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714146688 00000100:00100000:1.0:1787365126.667940:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787365126.667947:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714146688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365126.667978:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714146688:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365126.667983:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787365126.668000:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365126.668004:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365126.668040:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714146816:0@lo:400:kworker.0 00000100:00100000:0.0:1787365126.669950:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1874187714146944:0@lo:400:kworker.0 00000100:00100000:0.0:1787365126.669999:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714146688:0@lo:400:kworker.0 00000100:00100000:0.0:1787365126.670010:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714146560:0@lo:400:kworker.0 00000100:00100000:0.0:1787365126.670029:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714147072:0@lo:400:kworker.0 00000100:00100000:0.0:1787365126.670046:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365126.670055:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714147200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365126.670107:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365126.670976:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714147200 00000100:00100000:3.0:1787365126.670984:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714147200 00000100:00100000:3.0:1787365126.671030:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365126.671039:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714147200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365126.671073:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365126.671144:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714147200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365126.671150:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787365126.671867:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714147200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365126.811646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365126.814911:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688985216 00000100:00100000:3.0:1787365126.814925:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688985216 00000100:00100000:0.0:1787365126.815083:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 106 00000100:00100000:0.0:1787365126.815093:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+11:13778:x1874187688985216:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365126.815111:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365126.815139:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d342e5600/0xcfc9272e5fc2c2ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dfd3 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365126.815269:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d342e5600/0xcfc9272e5fc2c2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfd3 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365126.815280:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d342e5600/0xcfc9272e5fc2c2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfd3 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365126.815289:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5600, rc 0) 00000100:00100000:0.0:1787365126.815378:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13778:x1874187688985216:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 Request processed in 286us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365126.815384:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 106 00000100:00100000:1.0:1787365126.821881:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365126.822189:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688985344 00000100:00100000:3.0:1787365126.822200:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688985344 00000100:00100000:3.0:1787365126.822259:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 107 00000100:00100000:3.0:1787365126.822270:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d3fdc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13778:x1874187688985344:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365126.822735:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d3fdc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13778:x1874187688985344:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 Request processed in 465us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365126.822743:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 107 00000100:00100000:1.0:1787365126.828232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365126.830743:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688985472 00000100:00100000:3.0:1787365126.830758:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688985472 00000100:00100000:3.0:1787365126.830847:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 108 00000100:00100000:3.0:1787365126.830858:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13778:x1874187688985472:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365126.831115:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13778:x1874187688985472:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 Request processed in 258us (2894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365126.831124:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 108 00000100:00100000:0.0:1787365126.840283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365126.840478:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688985600 00000100:00100000:3.0:1787365126.840488:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688985600 00000100:00100000:3.0:1787365126.840551:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 109 00000100:00100000:3.0:1787365126.840561:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+12:13778:x1874187688985600:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365126.840579:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365126.840598:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dfda expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365126.840627:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfda expref: 13 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365126.840639:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d00031800/0xcfc9272e5fc2c2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfda expref: 13 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365126.840648:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031800, rc 0) 00000100:00100000:3.0:1787365126.841138:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13778:x1874187688985600:12345-192.168.204.2@tcp:101:ll_cfg_requeue.0 Request processed in 565us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365126.841147:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 109 00000100:00100000:1.0:1787365126.849723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365126.849833:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688985728 00000100:00100000:3.0:1787365126.849843:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688985728 00000100:00100000:3.0:1787365126.849892:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 110 00000100:00100000:3.0:1787365126.849900:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13778:x1874187688985728:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365126.850218:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13778:x1874187688985728:12345-192.168.204.2@tcp:501:ll_cfg_requeue.0 Request processed in 318us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365126.850226:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 110 00000100:00100000:2.0:1787365126.854690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365126.854782:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688985856 00000100:00100000:3.0:1787365126.854843:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688985856 00000100:00100000:3.0:1787365126.854936:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 111 00000100:00100000:3.0:1787365126.854953:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13778:x1874187688985856:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365126.855307:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aafc759a-56d4-42f5-b653-14dd754db9dc+13:13778:x1874187688985856:12345-192.168.204.2@tcp:503:ll_cfg_requeue.0 Request processed in 358us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365126.855318:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 111 10000000:01000000:3.0:1787365127.182222:0:14387:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787365127.182232:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d33f24000 from 10 10000000:01000000:3.0:1787365127.182238:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365127.182287:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d00030000/0xcfc9272e5fc2c2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365127.182300:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d00030000/0xcfc9272e5fc2c2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365127.182312:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d00030000/0xcfc9272e5fc2c2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365127.182338:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365127.182449:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365127.182510:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365127.182577:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714147328 00000100:00100000:1.0:1787365127.182586:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714147328 00000100:00100000:1.0:1787365127.182637:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787365127.182647:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+16:14387:x1874187714147328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365127.182661:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365127.182675:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d420c0600/0xcfc9272e5fc2c2c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2c2bc expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.182700:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d420c0600/0xcfc9272e5fc2c2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c2bc expref: 17 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.182710:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d420c0600/0xcfc9272e5fc2c2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c2bc expref: 17 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.182719:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0600, rc 0) 00000100:00100000:1.0:1787365127.182780:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+17:14387:x1874187714147328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365127.182813:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787365127.183080:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365127.183095:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d00030000/0xcfc9272e5fc2c2bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2c3 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365127.183176:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d00030000/0xcfc9272e5fc2c2bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2c2c3 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365127.183238:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365127.183271:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365127.183297:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d04f62240 going to sleep for 11 seconds 00000100:00100000:2.0:1787365127.183312:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714147456 00000100:00100000:2.0:1787365127.183315:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714147456 00000100:00100000:2.0:1787365127.183338:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787365127.183343:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+17:14387:x1874187714147456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365127.183630:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+17:14387:x1874187714147456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.183638:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787365127.183674:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365127.183702:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365127.183736:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365127.183756:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d04f62240 going to sleep for 11 seconds 00000100:00100000:3.0:1787365127.183764:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714147584 00000100:00100000:3.0:1787365127.183768:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714147584 00000100:00100000:3.0:1787365127.183873:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787365127.183885:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+17:14387:x1874187714147584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365127.184167:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+17:14387:x1874187714147584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 282us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365127.184174:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787365127.184200:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787365127.185759:0:16581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787365127.186038:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787365127.186062:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787365127.186073:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d00030000/0xcfc9272e5fc2c2bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2c3 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.186089:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d00030000/0xcfc9272e5fc2c2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2c3 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365127.186099:0:14387:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787365127.186102:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6d02d4f800 from 10 10000000:01000000:1.0:1787365127.186170:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365127.186202:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0800/0xcfc9272e5fc2c2ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.186209:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0800/0xcfc9272e5fc2c2ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.186219:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0800/0xcfc9272e5fc2c2ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365127.186242:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40adca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365127.186300:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365127.186386:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d1808f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787365127.186426:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714147712 00000100:00100000:2.0:1787365127.186432:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714147712 00000100:00100000:2.0:1787365127.186480:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787365127.186490:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+17:14387:x1874187714147712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365127.186502:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365127.186515:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34449600/0xcfc9272e5fc2c2d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2c2ca expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365127.186538:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34449600/0xcfc9272e5fc2c2d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c2ca expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365127.186550:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34449600/0xcfc9272e5fc2c2d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c2ca expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365127.186559:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449600, rc 0) 00000100:00100000:2.0:1787365127.186638:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+18:14387:x1874187714147712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.186645:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787365127.186710:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40adca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365127.186724:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0800/0xcfc9272e5fc2c2ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2d1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.186744:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0800/0xcfc9272e5fc2c2ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2c2d1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365127.186817:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40adca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365127.186843:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365127.186904:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d1808f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787365127.186933:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714147840 00000100:00100000:2.0:1787365127.186937:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714147840 00000100:00100000:2.0:1787365127.187076:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787365127.187084:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+18:14387:x1874187714147840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365127.190055:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+18:14387:x1874187714147840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2962us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.190068:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787365127.190079:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40adca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365127.190220:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365127.190263:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365127.190296:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11adc180 going to sleep for 11 seconds 00000100:00100000:2.0:1787365127.190348:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714147968 00000100:00100000:2.0:1787365127.190355:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714147968 00000100:00100000:2.0:1787365127.190402:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787365127.190600:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+18:14387:x1874187714147968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365127.191040:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714147968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365127.191300:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+18:14387:x1874187714147968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 351us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.191308:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000040:00080000:0.0:1787365127.192089:0:16583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787365127.192402:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787365127.192424:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787365127.192435:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0800/0xcfc9272e5fc2c2ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2d1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.192446:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0800/0xcfc9272e5fc2c2ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2d1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365127.192457:0:14387:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787365127.192460:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6c07201000 from 10 10000000:01000000:1.0:1787365127.192463:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365127.192495:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2c2d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.192503:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2c2d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.192513:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2c2d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365127.192535:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40adc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714148096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365127.192588:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365127.192669:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d1808f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787365127.192714:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714148096 00000100:00100000:2.0:1787365127.192720:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714148096 00000100:00100000:2.0:1787365127.192812:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787365127.192822:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+18:14387:x1874187714148096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365127.192834:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365127.192847:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c2df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfc9272e5fc2c2d8 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365127.192869:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c2d8 expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365127.192881:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d34449000/0xcfc9272e5fc2c2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfc9272e5fc2c2d8 expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365127.192890:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449000, rc 0) 00000100:00100000:2.0:1787365127.192984:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb110b-5671-42a1-88c0-bbf646942aa8+19:14387:x1874187714148096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.192991:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787365127.193203:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40adc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714148096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365127.193216:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2c2d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2df expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.193225:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2c2d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfc9272e5fc2c2df expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365127.193285:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d40adc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714148224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365127.193312:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365127.193344:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d1808f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365127.193390:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714148224 00000100:00100000:0.0:1787365127.193394:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714148224 00000100:00100000:0.0:1787365127.193422:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787365127.193429:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:14387:x1874187714148224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365127.193651:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:14387:x1874187714148224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365127.193658:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787365127.193697:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d40adc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714148224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365127.193736:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714148352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365127.193772:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365127.193810:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11adccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365127.193822:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714148352 00000100:00100000:0.0:1787365127.193825:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714148352 00000100:00100000:0.0:1787365127.193842:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787365127.193847:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:14387:x1874187714148352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365127.194044:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb110b-5671-42a1-88c0-bbf646942aa8+19:14387:x1874187714148352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365127.194051:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787365127.194084:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07eb110b-5671-42a1-88c0-bbf646942aa8:14387:1874187714148352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787365127.194762:0:16584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787365127.194883:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787365127.194899:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787365127.194907:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2c2d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2df expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.194916:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.102@tcp lock: ffff9b6d420c0c00/0xcfc9272e5fc2c2d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfc9272e5fc2c2df expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365127.440709:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365128.459139:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787365128.971491:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787365129.001071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.001122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.001154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.001183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.001201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.001223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.001243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.001270:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688986496 00000100:00100000:1.0:1787365129.001295:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688986496 00000100:00100000:1.0:1787365129.001353:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688986112 00000100:00100000:1.0:1787365129.001356:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688986112 00000100:00100000:1.0:1787365129.001379:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:1.0:1787365129.001389:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2366:x1874187688986496:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365129.001463:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2366:x1874187688986496:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365129.001471:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:1.0:1787365129.001490:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:1.0:1787365129.001496:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2366:x1874187688986112:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365129.001521:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2366:x1874187688986112:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365129.001527:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:1.0:1787365129.001558:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688986240 00000100:00100000:1.0:1787365129.001562:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688986240 00000100:00100000:1.0:1787365129.001582:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688986752 00000100:00100000:1.0:1787365129.001585:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688986752 00000100:00100000:1.0:1787365129.001597:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688986368 00000100:00100000:1.0:1787365129.001599:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688986368 00000100:00100000:1.0:1787365129.001623:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688986624 00000100:00100000:1.0:1787365129.001626:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688986624 00000100:00100000:1.0:1787365129.001640:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787365129.001646:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2366:x1874187688986240:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365129.001671:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2366:x1874187688986240:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365129.001678:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787365129.001690:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:1.0:1787365129.001704:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2366:x1874187688986752:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365129.001728:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2366:x1874187688986752:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365129.001734:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:1.0:1787365129.001745:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:1.0:1787365129.001751:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2366:x1874187688986368:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365129.001771:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2366:x1874187688986368:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 21us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365129.001778:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:1.0:1787365129.001813:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:1.0:1787365129.001820:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2366:x1874187688986624:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:1.0:1787365129.001842:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2366:x1874187688986624:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365129.001849:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00080000:1.0:1787365129.001871:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365129.001875:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787365129.001877:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365129.002065:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688985984 00000100:00100000:0.0:1787365129.002078:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688985984 00000100:00100000:0.0:1787365129.002174:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 121 00000100:00100000:0.0:1787365129.002187:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d352ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:2366:x1874187688985984:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365129.002251:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d352ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aafc759a-56d4-42f5-b653-14dd754db9dc+13:2366:x1874187688985984:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 67us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365129.002259:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 121 00000100:00100000:1.0:1787365129.150728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.150976:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688986880 00000100:00100000:2.0:1787365129.150989:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688986880 00000100:00100000:2.0:1787365129.151078:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:2.0:1787365129.151101:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:14436:x1874187688986880:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365129.151127:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365129.151232:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2c2e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dfe1 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.151532:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.151550:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.151568:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.151588:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.151596:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.151603:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.152987:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2c2fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153014:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2c2fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153026:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2c2fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365129.153215:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787365129.153220:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365129.153338:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2c2fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153600:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153608:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153616:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153624:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365129.153629:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153638:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153656:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365129.153659:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365129.153664:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153671:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c2ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153687:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153693:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153699:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153712:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365129.153715:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153722:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153730:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b6d104f9500) 00010000:00010000:2.0:1787365129.153733:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365129.153735:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.153741:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c2f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.154307:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2c2e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfe1 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.154331:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449c00/0xcfc9272e5fc2c2fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfe1 expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.154340:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d104f9800) 00010000:00010000:2.0:1787365129.154343:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365129.154347:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449c00, rc 0) 00000100:00100000:2.0:1787365129.154479:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:14436:x1874187688986880:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 3381us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365129.154490:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:2.0:1787365129.175765:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365129.176007:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688987136 00000100:00100000:3.0:1787365129.176020:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688987136 00000100:00100000:3.0:1787365129.176126:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:3.0:1787365129.176139:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:14436:x1874187688987136:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787365129.176171:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365129.176201:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c302 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dfe8 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.176311:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.176332:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.176348:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.179439:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.179466:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.179481:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186484:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2c317 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186511:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2c317 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186524:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2c317 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365129.186540:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787365129.186858:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186868:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186875:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186881:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365129.186885:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186893:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186906:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d104f9800) 00010000:00010000:2.0:1787365129.186921:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365129.186927:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186933:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c309 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186958:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186963:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186969:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186974:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365129.186977:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186982:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.186990:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b6d02948600) 00010000:00010000:2.0:1787365129.186992:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365129.186995:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.187001:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c310 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.190266:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c302 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfe8 expref: 10 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.190297:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448400/0xcfc9272e5fc2c317 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfe8 expref: 9 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.190320:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787365129.190324:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365129.190328:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448400, rc 0) 00000100:00100000:2.0:1787365129.191766:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14436:x1874187688987136:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 15621us (16007us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787365129.191779:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:1.0:1787365129.211238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365129.211936:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688987264 00000100:00100000:3.0:1787365129.211953:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688987264 00000100:00100000:3.0:1787365129.212042:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:3.0:1787365129.212056:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14436:x1874187688987264:12345-192.168.204.2@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787365129.212246:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14436:x1874187688987264:12345-192.168.204.2@tcp:59:lhsmtool_posix.0 Request processed in 193us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365129.212255:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:1.0:1787365129.244034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365129.244205:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688987392 00000100:00100000:0.0:1787365129.244216:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688987392 00000100:00100000:0.0:1787365129.244291:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:0.0:1787365129.244302:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14442:x1874187688987392:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787365129.244342:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365129.244378:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2c325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dfef expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.244569:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.244585:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.244597:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.244652:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.244659:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.244665:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245569:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245580:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245588:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245594:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787365129.245607:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245616:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245631:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:0.0:1787365129.245634:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365129.245639:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245646:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245659:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245666:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245671:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245676:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787365129.245679:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245685:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245692:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d2000c500) 00010000:00010000:0.0:1787365129.245695:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365129.245704:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245711:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c333 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245752:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2c325 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfef expref: 10 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245762:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:0.0:1787365129.245765:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365129.245768:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2c325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfef expref: 10 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.245778:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5000, rc 0) 00000100:00100000:0.0:1787365129.245904:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14442:x1874187688987392:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1603us (1880us total) trans 0 rc 301/301 00000100:00100000:0.0:1787365129.245922:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:2.0:1787365129.256202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.257587:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688987520 00000100:00100000:1.0:1787365129.257602:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688987520 00000100:00100000:1.0:1787365129.257680:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:1.0:1787365129.257691:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14442:x1874187688987520:12345-192.168.204.2@tcp:700:lfs.0 00000100:00100000:1.0:1787365129.258178:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14442:x1874187688987520:12345-192.168.204.2@tcp:700:lfs.0 Request processed in 486us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365129.258199:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:1.0:1787365129.266686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.266835:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688987776 00000100:00100000:2.0:1787365129.266847:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688987776 00000100:00100000:3.0:1787365129.267011:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:3.0:1787365129.267024:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14442:x1874187688987776:12345-192.168.204.2@tcp:36:lfs.0 00010000:00010000:3.0:1787365129.267097:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365129.267125:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c268 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67df6a expref: 9 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.267145:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:3.0:1787365129.267150:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365129.267657:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.267673:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 5 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.267682:0:14391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.267717:0:14391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 5 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.267745:0:14391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 5 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365129.267761:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14391:1874187714148480:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787365129.267955:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787365129.270382:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14391:1874187714148480:192.168.204.2@tcp:104: 00010000:00010000:1.0:1787365129.270408:0:14391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365129.277054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365129.280500:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688987904 00000100:00100000:0.0:1787365129.280517:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688987904 00010000:00010000:0.0:1787365129.280568:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 6 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365129.280670:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:0.0:1787365129.280680:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2367:x1874187688987904:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365129.280696:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365129.280702:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 6 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.280735:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 6 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.280757:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031600/0xcfc9272e5fc2c2a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dfcc expref: 6 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.280777:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:0.0:1787365129.280783:0:14376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.280822:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.280830:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.280863:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365129.280931:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2367:x1874187688987904:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 252us (3885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365129.280939:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00010000:00010000:3.0:1787365129.281116:0:14391:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.281125:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.281146:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.281155:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.281163:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365129.282510:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787365129.282525:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.282535:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.282542:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.282559:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787365129.282563:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.282570:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.282582:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:3.0:1787365129.282586:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365129.282590:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.282597:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c33a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365129.282615:0:14391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aebc6485 reply state 00000000c6bc2581 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365129.282624:0:14391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787365129.282716:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+10:14442:x1874187688987776:12345-192.168.204.2@tcp:36:lfs.0 Request processed in 15693us (16037us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787365129.282725:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00010000:00010000:3.0:1787365129.289683:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.289700:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.289707:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.289726:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787365129.289731:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.289738:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.289756:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d02948d00) 00010000:00010000:3.0:1787365129.289759:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365129.289764:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.289770:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c341 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365129.407598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.407867:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688988032 00000100:00100000:2.0:1787365129.407877:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688988032 00000100:00100000:2.0:1787365129.407951:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:2.0:1787365129.407963:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:14450:x1874187688988032:12345-192.168.204.2@tcp:101:lctl.0 00010000:00010000:2.0:1787365129.407988:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365129.408011:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dff6 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.408250:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2c34f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.408264:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2c34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.408275:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2c34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365129.408337:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787365129.408356:0:14392:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365129.408399:0:14392:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2c34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.408509:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dff6 expref: 11 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.408528:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448800/0xcfc9272e5fc2c34f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dff6 expref: 10 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.408536:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787365129.408540:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365129.408543:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448800, rc 0) 00000100:00100000:2.0:1787365129.408611:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+10:14450:x1874187688988032:12345-192.168.204.2@tcp:101:lctl.0 Request processed in 651us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365129.408619:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 20 00000100:00100000:1.0:1787365129.448310:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.448423:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688988160 00000100:00100000:2.0:1787365129.448442:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688988160 00000100:00100000:2.0:1787365129.448508:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:2.0:1787365129.448521:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:14451:x1874187688988160:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787365129.448543:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365129.448565:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67dffd expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.448631:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2c35d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.448644:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2c35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.448673:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2c35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365129.448734:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787365129.448739:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365129.448768:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2c35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.449003:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dffd expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.449021:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449a00/0xcfc9272e5fc2c35d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67dffd expref: 6 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.449029:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787365129.449032:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365129.449035:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34449a00, rc 0) 00000100:00100000:2.0:1787365129.449554:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:14451:x1874187688988160:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1035us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365129.449562:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 21 00000100:00100000:3.0:1787365129.463416:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365129.466570:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688988288 00000100:00100000:0.0:1787365129.466592:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688988288 00000100:00100000:0.0:1787365129.466738:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:0.0:1787365129.466749:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:14451:x1874187688988288:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787365129.466769:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365129.466815:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2c364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e004 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.466911:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.466926:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.466937:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.466951:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.466958:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.466964:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467130:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2c379 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467138:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2c379 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467145:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2c379 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365129.467181:0:16551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787365129.467185:0:16551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365129.467208:0:16551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2c379 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467229:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467235:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467242:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467247:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787365129.467251:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467257:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467269:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787365129.467272:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365129.467276:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467283:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c36b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467297:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467302:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467306:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467315:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787365129.467318:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467324:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467330:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d2000c500) 00010000:00010000:0.0:1787365129.467333:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365129.467335:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467340:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c372 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467371:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2c364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e004 expref: 8 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467383:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2c379 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e004 expref: 7 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.467389:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d2000c600) 00010000:00010000:0.0:1787365129.467391:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365129.467393:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4200, rc 0) 00000100:00100000:0.0:1787365129.467468:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b87453e-debf-4f7b-9b54-26b3375a65eb+7:14451:x1874187688988288:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 721us (4063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365129.467476:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 22 00000100:00100000:3.0:1787365129.475423:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.475590:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688988544 00000100:00100000:1.0:1787365129.475600:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688988544 00000100:00100000:1.0:1787365129.475666:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 23 00000100:00100000:1.0:1787365129.475676:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+7:14451:x1874187688988544:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:1.0:1787365129.475699:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365129.475725:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2c380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e00b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365129.475886:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787365129.476542:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2c380 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e00b expref: 9 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365129.476558:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787365129.476562:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365129.476567:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2c380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e00b expref: 9 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365129.476581:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1c00, rc 0) 00000100:00100000:1.0:1787365129.476647:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+8:14451:x1874187688988544:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 972us (1234us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787365129.476668:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 23 00010000:00010000:0.0:1787365129.483167:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365129.493665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.495591:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688988800 00000100:00100000:2.0:1787365129.495615:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688988800 00000100:00100000:2.0:1787365129.495707:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:2.0:1787365129.495719:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+8:14451:x1874187688988800:12345-192.168.204.2@tcp:36:lfs.0 00010000:00010000:2.0:1787365129.495778:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365129.495864:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4200/0xcfc9272e5fc2c379 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e004 expref: 8 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.495905:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d2000c600) 00010000:00010000:2.0:1787365129.495918:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365129.495947:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.495962:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.495971:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365129.496218:0:14392:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a67870b reply state 00000000f3c78d34 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365129.496228:0:14392:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787365129.496241:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787365129.496347:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+9:14451:x1874187688988800:12345-192.168.204.2@tcp:36:lfs.0 Request processed in 629us (2697us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787365129.496355:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 24 00000100:00100000:3.0:1787365129.500450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.500555:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688989056 00000100:00100000:1.0:1787365129.500569:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688989056 00000100:00100000:1.0:1787365129.500643:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:1.0:1787365129.500653:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+9:14451:x1874187688989056:12345-192.168.204.2@tcp:35:lfs.0 00010000:00010000:2.0:1787365129.501388:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.501401:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.501409:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.501416:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365129.501421:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.501445:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.501462:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d104f9700) 00010000:00010000:2.0:1787365129.501465:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787365129.501469:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.501476:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c38e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365129.505003:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+9:14451:x1874187688989056:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 4337us (4554us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787365129.505020:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:3.0:1787365129.511170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365129.511649:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688989312 00000100:00100000:0.0:1787365129.511664:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688989312 00000100:00100000:0.0:1787365129.511873:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:0.0:1787365129.511888:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+9:14451:x1874187688989312:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:0.0:1787365129.511925:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365129.511953:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2c395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e012 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512276:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512295:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512309:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512326:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512333:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512338:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365129.512520:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787365129.512645:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512655:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512683:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512690:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787365129.512695:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512704:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512719:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:0.0:1787365129.512722:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365129.512727:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.512734:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5200/0xcfc9272e5fc2c39c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.513140:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.513149:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.513156:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.513161:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:0.0:1787365129.513165:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.513251:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.513264:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d2000c500) 00010000:00010000:0.0:1787365129.513267:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365129.513270:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.513276:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4600/0xcfc9272e5fc2c3a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365129.513430:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2c395 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e012 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365129.513443:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:1.0:1787365129.513447:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365129.513450:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5000/0xcfc9272e5fc2c395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e012 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365129.513463:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5000, rc 0) 00000100:00100000:1.0:1787365129.513595:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+10:14451:x1874187688989312:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 1710us (2439us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787365129.513606:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 25 00000100:00100000:3.0:1787365129.517003:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.517359:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688989440 00000100:00100000:2.0:1787365129.517384:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688989440 00000100:00100000:2.0:1787365129.517472:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 26 00000100:00100000:2.0:1787365129.517486:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+10:14451:x1874187688989440:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787365129.517521:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365129.517554:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2c3b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e019 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.517688:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.517706:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.517721:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365129.517820:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787365129.517824:0:14392:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365129.517875:0:14392:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.517908:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2c3b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 12 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.517929:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 11 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.517938:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d104f9f00) 00010000:00010000:2.0:1787365129.517941:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365129.517946:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448e00, rc 0) 00000100:00100000:2.0:1787365129.518020:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+11:14451:x1874187688989440:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 537us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365129.518029:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 26 00000100:00100000:0.0:1787365129.532549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.534026:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688989568 00000100:00100000:2.0:1787365129.534289:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688989568 00000100:00100000:3.0:1787365129.534578:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:3.0:1787365129.534592:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+11:14451:x1874187688989568:12345-192.168.204.2@tcp:37:lfs.0 00000100:00100000:3.0:1787365129.542230:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+11:14451:x1874187688989568:12345-192.168.204.2@tcp:37:lfs.0 Request processed in 7623us (9679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365129.542248:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:2.0:1787365129.547940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365129.548540:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688989824 00000100:00100000:1.0:1787365129.548569:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688989824 00000100:00100000:1.0:1787365129.549692:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:1.0:1787365129.549717:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0548dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+11:14451:x1874187688989824:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:1.0:1787365129.550143:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0548dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+12:14451:x1874187688989824:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 435us (2220us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787365129.550152:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:1.0:1787365129.606731:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.606846:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688989952 00000100:00100000:2.0:1787365129.606861:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688989952 00000100:00100000:2.0:1787365129.606936:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 27 00000100:00100000:2.0:1787365129.606947:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+10:14457:x1874187688989952:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:2.0:1787365129.606975:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365129.607004:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2c3bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e020 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607102:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607154:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607167:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607186:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607193:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607200:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607355:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334a00/0xcfc9272e5fc2c3d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607364:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334a00/0xcfc9272e5fc2c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607372:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334a00/0xcfc9272e5fc2c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365129.607412:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787365129.607415:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365129.607466:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334a00/0xcfc9272e5fc2c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607480:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607502:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607509:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607515:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365129.607520:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607528:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607554:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787365129.607559:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365129.607565:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607572:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c3c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607588:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607594:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607599:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607604:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449400 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365129.607613:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607619:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607627:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d104f9700) 00010000:00010000:2.0:1787365129.607630:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365129.607633:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607639:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449400/0xcfc9272e5fc2c3cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607679:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34449800/0xcfc9272e5fc2c3bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e020 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607694:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334a00/0xcfc9272e5fc2c3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e020 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.607701:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d104f9f00) 00010000:00010000:2.0:1787365129.607703:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787365129.607706:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334a00, rc 0) 00000100:00100000:2.0:1787365129.607846:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+11:14457:x1874187688989952:12345-192.168.204.2@tcp:101:bash.0 Request processed in 899us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365129.607856:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 27 00000100:00100000:0.0:1787365129.618209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365129.618466:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688990208 00000100:00100000:3.0:1787365129.618500:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688990208 00000100:00100000:3.0:1787365129.618590:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 28 00000100:00100000:3.0:1787365129.618604:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+11:14457:x1874187688990208:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:3.0:1787365129.618633:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365129.618662:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c3db lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e027 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.619275:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.619295:0:16551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 11 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.619307:0:16551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.619356:0:16551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 11 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.619374:0:16551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 11 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365129.619391:0:16551:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16551:1874187714148608:192.168.204.2@tcp:104: 00000100:00100000:3.0:1787365129.619534:0:16551:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49000 going to sleep for 11 seconds 00000100:00100000:1.0:1787365129.624021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365129.624224:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688990336 00000100:00100000:0.0:1787365129.624239:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688990336 00010000:00010000:0.0:1787365129.624303:0:14377:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 12 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365129.626306:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:2.0:1787365129.626352:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+12:2366:x1874187688990336:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365129.626385:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365129.626418:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 12 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.626440:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 12 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.626473:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d104f9f00) 00010000:00010000:2.0:1787365129.626479:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.626490:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.626498:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.626523:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365129.626629:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b87453e-debf-4f7b-9b54-26b3375a65eb+12:2366:x1874187688990336:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 307us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365129.626639:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00010000:00010000:3.0:1787365129.627271:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448e00/0xcfc9272e5fc2c3b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e019 expref: 11 pid: 14392 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365129.627293:0:16551:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16551:1874187714148608:192.168.204.2@tcp:104: 00010000:00010000:3.0:1787365129.627349:0:16551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.627361:0:16551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.627367:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.627398:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.627409:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.627419:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631149:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631181:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631196:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365129.631212:0:16551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787365129.631255:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631263:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631293:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631300:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787365129.631306:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631317:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631333:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d104f9f00) 00010000:00010000:3.0:1787365129.631337:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365129.631354:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631361:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030600/0xcfc9272e5fc2c3e2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365129.631380:0:16551:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070a5ba26 reply state 000000005798c4e2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365129.631390:0:16551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787365129.631441:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031c00/0xcfc9272e5fc2c3db lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 14 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631461:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 13 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.631469:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:3.0:1787365129.631471:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787365129.631479:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d00031e00, rc 0) 00000100:00100000:3.0:1787365129.631591:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+14:14457:x1874187688990208:12345-192.168.204.2@tcp:101:bash.0 Request processed in 12989us (13398us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787365129.631603:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 28 00010000:00010000:3.0:1787365129.638733:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.638760:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.638769:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.638777:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787365129.638830:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.638842:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.638867:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b6d02948d00) 00010000:00010000:3.0:1787365129.638871:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365129.638878:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365129.638884:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c3e9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365129.663306:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.663665:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688990464 00000100:00100000:2.0:1787365129.663678:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688990464 00000100:00100000:2.0:1787365129.663755:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:2.0:1787365129.663768:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+13:14457:x1874187688990464:12345-192.168.204.2@tcp:101:bash.0 00010000:00010000:2.0:1787365129.663858:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365129.663887:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c3fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e02e expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.664104:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.664129:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.664142:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365129.664231:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787365129.664236:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365129.664275:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.664305:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.664337:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c3fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 15 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.664361:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 14 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.664370:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:0.0:1787365129.664373:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365129.664377:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4a00, rc 0) 00000100:00100000:0.0:1787365129.664472:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+14:14457:x1874187688990464:12345-192.168.204.2@tcp:101:bash.0 Request processed in 706us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365129.664484:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:1.0:1787365129.667870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365129.668027:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688990720 00000100:00100000:3.0:1787365129.668041:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688990720 00000100:00100000:3.0:1787365129.668127:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:3.0:1787365129.668140:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+14:14457:x1874187688990720:12345-192.168.204.2@tcp:35:bash.0 00000100:00100000:3.0:1787365129.668646:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+15:14457:x1874187688990720:12345-192.168.204.2@tcp:35:bash.0 Request processed in 507us (791us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787365129.668656:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:3.0:1787365129.766734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.766912:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688990976 00000100:00100000:2.0:1787365129.766935:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688990976 00000100:00100000:2.0:1787365129.766997:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00100000:2.0:1787365129.767008:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+15:14467:x1874187688990976:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787365129.767033:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365129.767063:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c40c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e035 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365129.767191:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787365129.767492:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c40c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e035 expref: 17 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.767507:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d104f9900) 00010000:00010000:2.0:1787365129.767510:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787365129.767516:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c40c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e035 expref: 17 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.767532:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334e00, rc 0) 00000100:00100000:2.0:1787365129.767595:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+16:14467:x1874187688990976:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 589us (872us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787365129.767602:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00100000:0.0:1787365129.773449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365129.779393:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688991232 00000100:00100000:3.0:1787365129.779410:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688991232 00000100:00100000:3.0:1787365129.779482:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:3.0:1787365129.779493:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+16:14467:x1874187688991232:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:3.0:1787365129.779782:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+17:14467:x1874187688991232:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 290us (6343us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787365129.779815:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:1.0:1787365129.813974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.814232:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688991488 00000100:00100000:2.0:1787365129.814250:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688991488 00000100:00100000:2.0:1787365129.814323:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 31 00000100:00100000:2.0:1787365129.814334:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+17:14470:x1874187688991488:12345-192.168.204.2@tcp:101:lfs.0 00010000:00010000:2.0:1787365129.814361:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365129.814394:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c41a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e03c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.814518:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c421 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.814532:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c421 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.814547:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c421 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365129.814559:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787365129.814696:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c41a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e03c expref: 20 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.814718:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c421 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e03c expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.814727:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365129.814730:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365129.814734:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334600, rc 0) 00000100:00100000:2.0:1787365129.814845:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+19:14470:x1874187688991488:12345-192.168.204.2@tcp:101:lfs.0 Request processed in 512us (881us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787365129.814853:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 31 00000100:00100000:1.0:1787365129.822462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365129.822566:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688991616 00000100:00100000:2.0:1787365129.822578:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688991616 00000100:00100000:2.0:1787365129.822648:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00100000:2.0:1787365129.822659:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+19:14470:x1874187688991616:12345-192.168.204.2@tcp:54:lfs.0 00010000:00010000:2.0:1787365129.822727:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822758:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822770:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822881:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822889:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822896:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822902:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365129.822906:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822914:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822926:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365129.822929:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787365129.822934:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365129.822941:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c42f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365129.823023:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+19:14470:x1874187688991616:12345-192.168.204.2@tcp:54:lfs.0 Request processed in 365us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365129.823038:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 32 00000100:00100000:1.0:1787365129.829302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365129.829375:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688991872 00000100:00100000:0.0:1787365129.829386:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688991872 00000100:00100000:0.0:1787365129.829445:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:0.0:1787365129.829455:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+19:14470:x1874187688991872:12345-192.168.204.2@tcp:35:lfs.0 00000100:00100000:0.0:1787365129.829707:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+20:14470:x1874187688991872:12345-192.168.204.2@tcp:35:lfs.0 Request processed in 252us (413us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787365129.829715:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:1.0:1787365129.831155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365129.831343:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688992000 00000100:00100000:0.0:1787365129.831351:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688992000 00000100:00100000:0.0:1787365129.831456:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:0.0:1787365129.831466:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+20:2366:x1874187688992000:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365129.831492:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365129.831517:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c421 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e03c expref: 20 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365129.831539:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:0.0:1787365129.831544:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365129.831592:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+19:2366:x1874187688992000:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 128us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365129.831600:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00000040:00080000:1.0:1787365129.995615:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787365130.131331:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365130.131431:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688992256 00000100:00100000:2.0:1787365130.131514:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688992256 00000100:00100000:2.0:1787365130.131623:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:2.0:1787365130.131635:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+19:14501:x1874187688992256:12345-192.168.204.2@tcp:101:cat.0 00010000:00010000:2.0:1787365130.131660:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365130.131684:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c436 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e043 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.131810:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c43d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.131826:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c43d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.131837:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c43d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365130.131848:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787365130.132016:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c436 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e043 expref: 22 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.132037:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c43d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e043 expref: 21 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.132046:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365130.132049:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365130.132053:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28335c00, rc 0) 00000100:00100000:2.0:1787365130.132135:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+21:14501:x1874187688992256:12345-192.168.204.2@tcp:101:cat.0 Request processed in 502us (815us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787365130.132144:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 33 00000100:00100000:1.0:1787365130.145352:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365130.145407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365130.145514:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688992640 00000100:00100000:0.0:1787365130.145525:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688992640 00000100:00100000:0.0:1787365130.145601:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:0.0:1787365130.145611:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+21:2364:x1874187688992640:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365130.145628:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365130.145657:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c43d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e043 expref: 21 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.145680:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:0.0:1787365130.145686:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365130.145738:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+20:2364:x1874187688992640:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 128us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365130.145747:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:2.0:1787365130.148353:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688992512 00000100:00100000:2.0:1787365130.148368:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688992512 00000100:00100000:2.0:1787365130.148514:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:2.0:1787365130.148527:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+20:14501:x1874187688992512:12345-192.168.204.2@tcp:35:cat.0 00000100:00100000:2.0:1787365130.148923:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+21:14501:x1874187688992512:12345-192.168.204.2@tcp:35:cat.0 Request processed in 398us (3513us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787365130.150030:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 8 00000100:00100000:0.0:1787365130.231661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365130.232285:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688992896 00000100:00100000:2.0:1787365130.232300:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688992896 00000100:00100000:2.0:1787365130.232632:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 34 00000100:00100000:2.0:1787365130.232647:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+21:14507:x1874187688992896:12345-192.168.204.2@tcp:101:dd.0 00010000:00010000:2.0:1787365130.232680:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365130.232913:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c44b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e04a expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.233233:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.233250:0:14392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 22 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.233260:0:14392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 22 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.233293:0:14392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.233472:0:14392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 22 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.233491:0:14392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 22 pid: 14391 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365130.233509:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14392:1874187714148736:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787365130.233736:0:14392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 22 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.233745:0:14392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 22 pid: 16551 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365130.233755:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14392:1874187714148864:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787365130.233819:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787365130.246021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365130.246084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365130.246191:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688993024 00000100:00100000:3.0:1787365130.246204:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688993024 00010000:00010000:3.0:1787365130.246260:0:14377:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 23 pid: 14391 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365130.246309:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688993152 00000100:00100000:3.0:1787365130.246312:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688993152 00010000:00010000:3.0:1787365130.246337:0:14377:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 24 pid: 16551 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365130.246354:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:3.0:1787365130.246365:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d35504c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:2364:x1874187688993024:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365130.246384:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365130.246403:0:14377:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 24 pid: 14391 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.246446:0:14377:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 24 pid: 14391 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.246477:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:3.0:1787365130.246483:0:14377:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.246494:0:14377:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.246503:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365130.246584:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d35504c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:2364:x1874187688993024:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 220us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365130.246593:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:3.0:1787365130.246672:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 12 00000100:00100000:3.0:1787365130.246680:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+23:2365:x1874187688993152:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365130.247000:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365130.247008:0:14377:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 23 pid: 16551 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.247020:0:14377:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 23 pid: 16551 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.247033:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:3.0:1787365130.247037:0:14377:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.247056:0:14377:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.247073:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365130.247095:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365130.247119:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+23:2365:x1874187688993152:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 440us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365130.247126:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 12 00010000:00010000:2.0:1787365130.248118:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4a00/0xcfc9272e5fc2c405 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e02e expref: 22 pid: 14391 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365130.248149:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14392:1874187714148736:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787365130.248168:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00031e00/0xcfc9272e5fc2c3f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e027 expref: 21 pid: 16551 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365130.248210:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14392:1874187714148864:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787365130.248246:0:14392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.248258:0:14392:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.248265:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365130.248357:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787365130.249161:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c44b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e04a expref: 22 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.249191:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335600/0xcfc9272e5fc2c452 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e04a expref: 21 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.249202:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365130.249206:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787365130.249210:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28335600, rc 0) 00000100:00100000:2.0:1787365130.249361:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+21:14507:x1874187688992896:12345-192.168.204.2@tcp:101:dd.0 Request processed in 16717us (17716us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787365130.249373:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 34 00000100:00100000:1.0:1787365130.254210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365130.254746:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688993408 00000100:00100000:0.0:1787365130.254761:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688993408 00000100:00100000:0.0:1787365130.255037:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 35 00000100:00100000:0.0:1787365130.255129:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+21:14507:x1874187688993408:12345-192.168.204.2@tcp:36:dd.0 00010000:00010000:0.0:1787365130.255620:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.255761:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.255776:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365130.255863:0:14391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787365130.255908:0:14391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032e5f37b reply state 0000000072519418 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365130.255918:0:14391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365130.256353:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14507:x1874187688993408:12345-192.168.204.2@tcp:36:dd.0 Request processed in 1226us (2154us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787365130.256362:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 35 00000020:00080000:0.0:1787365130.256369:0:14391:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787365130.263191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00010000:00010000:2.0:1787365130.263230:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.263249:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.263279:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.263981:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5a00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365130.263990:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.264003:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.264026:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365130.264030:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365130.264036:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.264044:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5a00/0xcfc9272e5fc2c460 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365130.265119:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688993536 00000100:00100000:2.0:1787365130.265137:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688993536 00000100:00100000:2.0:1787365130.265226:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 36 00000100:00100000:2.0:1787365130.265238:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+23:14507:x1874187688993536:12345-192.168.204.2@tcp:101:dd.0 00010000:00010000:2.0:1787365130.265389:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365130.265417:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c467 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e051 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.265497:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c467 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e051 expref: 24 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.265683:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c467 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e051 expref: 24 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.265708:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365130.265711:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365130.265714:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334e00, rc 0) 00000100:00100000:2.0:1787365130.267136:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14507:x1874187688993536:12345-192.168.204.2@tcp:101:dd.0 Request processed in 1885us (3942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365130.267152:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 36 00000100:00100000:3.0:1787365130.286103:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365130.286290:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688993792 00000100:00100000:0.0:1787365130.286304:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688993792 00000100:00100000:0.0:1787365130.286402:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:0.0:1787365130.286415:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14507:x1874187688993792:12345-192.168.204.2@tcp:103:dd.0 00010000:00010000:0.0:1787365130.286437:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365130.286470:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c467 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e051 expref: 24 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.286499:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:0.0:1787365130.286507:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365130.286592:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+23:14507:x1874187688993792:12345-192.168.204.2@tcp:103:dd.0 Request processed in 179us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365130.286615:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:1.0:1787365130.290318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365130.290452:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688993920 00000100:00100000:2.0:1787365130.290466:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688993920 00000100:00100000:2.0:1787365130.290551:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:2.0:1787365130.290563:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+23:14507:x1874187688993920:12345-192.168.204.2@tcp:58:dd.0 00010000:00010000:2.0:1787365130.290706:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.290729:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365130.290742:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365130.291774:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365130.292002:0:14390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787365130.292104:0:14390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787365130.292271:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+23:14507:x1874187688993920:12345-192.168.204.2@tcp:58:dd.0 Request processed in 1702us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365130.292295:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 37 00000100:00100000:2.0:1787365130.298756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365130.304745:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688994048 00000100:00100000:0.0:1787365130.304761:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688994048 00000100:00100000:0.0:1787365130.304903:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 38 00000100:00100000:0.0:1787365130.304915:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+23:14507:x1874187688994048:12345-192.168.204.2@tcp:101:dd.0 00010000:00010000:0.0:1787365130.304939:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365130.304973:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5e00/0xcfc9272e5fc2c475 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e058 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.305172:0:14392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.305201:0:14392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5e00/0xcfc9272e5fc2c475 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e058 expref: 24 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.305224:0:14392:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.305239:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5e00/0xcfc9272e5fc2c475 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e058 expref: 24 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.305254:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:0.0:1787365130.305257:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365130.305261:0:14392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5e00/0xcfc9272e5fc2c475 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e058 expref: 24 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365130.305268:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5e00, rc 0) 00000100:00100000:0.0:1787365130.305337:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14507:x1874187688994048:12345-192.168.204.2@tcp:101:dd.0 Request processed in 425us (6593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365130.305359:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 38 00010000:00010000:1.0:1787365130.507684:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787365131.019082:0:14422:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787365131.019092:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365131.019134:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787365131.019144:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787365131.019279:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14422:1874187714148992:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787365131.019379:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f989c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365131.025539:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14422:1874187714148992:192.168.204.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787365131.027848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.028055:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688994176 00000100:00100000:2.0:1787365131.028064:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688994176 00000100:00100000:2.0:1787365131.028133:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:2.0:1787365131.028146:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14508:x1874187688994176:12345-192.168.204.2@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787365131.028226:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14508:x1874187688994176:12345-192.168.204.2@tcp:900:lhsmtool_posix.0 Request processed in 85us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.028233:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00080000:1.0:1787365131.028497:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365131.033957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.034226:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688994304 00000100:00100000:2.0:1787365131.034236:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688994304 00000100:00100000:2.0:1787365131.034300:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:2.0:1787365131.034312:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14508:x1874187688994304:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787365131.034346:0:14390:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787365131.034469:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14508:x1874187688994304:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 159us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.034478:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 39 00000100:00100000:0.0:1787365131.048451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.048783:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688994432 00000100:00100000:2.0:1787365131.048818:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688994432 00000100:00100000:2.0:1787365131.048879:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 40 00000100:00100000:2.0:1787365131.048890:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14508:x1874187688994432:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787365131.048974:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.048992:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049023:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049099:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049108:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049115:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049139:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049148:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049155:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365131.049197:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787365131.049201:0:14392:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365131.049215:0:14392:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049227:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049234:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049253:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049259:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.049264:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049272:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049285:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787365131.049288:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365131.049292:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049300:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c47c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049327:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049334:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049341:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049346:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.049349:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049365:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049374:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b6d104f9700) 00010000:00010000:2.0:1787365131.049377:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365131.049380:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049386:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c483 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049404:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049411:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049417:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049423:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.049426:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049432:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049440:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365131.049442:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365131.049445:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.049461:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c48a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.049540:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14508:x1874187688994432:12345-192.168.204.2@tcp:34:lhsmtool_posix.0 Request processed in 650us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.049550:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 40 00000100:00100000:1.0:1787365131.063228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.063417:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688994688 00000100:00100000:2.0:1787365131.063427:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688994688 00000100:00100000:2.0:1787365131.063486:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:2.0:1787365131.063496:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+24:14508:x1874187688994688:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365131.063515:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365131.063534:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c491 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e05f expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063640:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063657:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063669:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365131.063680:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787365131.063834:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063843:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063868:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063873:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334600 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.063877:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063886:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063899:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365131.063902:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787365131.063906:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063912:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c498 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063959:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c491 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e05f expref: 26 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.063970:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d104f9500) 00010000:00010000:2.0:1787365131.064211:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787365131.064217:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c491 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e05f expref: 26 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.064230:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334200, rc 0) 00000100:00100000:2.0:1787365131.064362:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+25:14508:x1874187688994688:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 867us (1145us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787365131.064381:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 41 00000100:00100000:0.0:1787365131.081823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.081917:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688994816 00000100:00100000:2.0:1787365131.081927:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688994816 00000100:00100000:2.0:1787365131.081986:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:2.0:1787365131.081996:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+25:14508:x1874187688994816:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787365131.082044:0:14392:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787365131.082176:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+25:14508:x1874187688994816:12345-192.168.204.2@tcp:53:lhsmtool_posix.0 Request processed in 182us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.082184:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 42 00000100:00100000:1.0:1787365131.088989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.089132:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688995072 00000100:00100000:2.0:1787365131.089143:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688995072 00000100:00100000:2.0:1787365131.089210:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:2.0:1787365131.089220:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+25:14508:x1874187688995072:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365131.089241:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365131.089265:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e066 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365131.090385:0:14390:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1787365131.090393:0:14390:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787365131.090453:0:14390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787365131.090757:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c4ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.090779:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.090814:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.090887:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e066 expref: 28 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.090907:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c4ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e066 expref: 27 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.090916:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d104f9700) 00010000:00010000:2.0:1787365131.090919:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365131.090922:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d28334600, rc 0) 00000100:00100000:2.0:1787365131.091055:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+27:14508:x1874187688995072:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 1826us (2065us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787365131.091064:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 43 00000100:00100000:1.0:1787365131.094966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.095112:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688995328 00000100:00100000:2.0:1787365131.095121:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688995328 00000100:00100000:2.0:1787365131.095182:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:2.0:1787365131.095193:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+27:14508:x1874187688995328:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787365131.095255:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365131.095283:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334600/0xcfc9272e5fc2c4ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e066 expref: 27 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095305:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d104f9700) 00010000:00010000:2.0:1787365131.095485:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365131.095514:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095530:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095558:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095576:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095584:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095591:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095667:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095675:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095682:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095688:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.095692:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095699:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095709:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d104f9f00) 00010000:00010000:2.0:1787365131.095712:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365131.095715:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095728:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335c00/0xcfc9272e5fc2c4bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095740:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095746:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095752:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095758:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.095761:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095767:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095774:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd82e3b86 (ffff9b6d104f9300) 00010000:00010000:2.0:1787365131.095776:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365131.095779:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.095808:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334e00/0xcfc9272e5fc2c4c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd82e3b86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.095940:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+26:14508:x1874187688995328:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 748us (983us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787365131.095948:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 44 00000100:00100000:0.0:1787365131.098757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365131.098856:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688995456 00000100:00100000:1.0:1787365131.098866:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688995456 00000100:00100000:1.0:1787365131.098998:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:1.0:1787365131.099009:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+26:14508:x1874187688995456:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787365131.099037:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365131.099070:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c4c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e06d expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.099108:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2c4d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.099122:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2c4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.099135:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2c4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.099240:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c4c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e06d expref: 28 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.099260:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1c00/0xcfc9272e5fc2c4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e06d expref: 27 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.099268:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:1.0:1787365131.099277:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787365131.099282:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c1c00, rc 0) 00000100:00100000:1.0:1787365131.099515:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+27:14508:x1874187688995456:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 507us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365131.099523:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 45 00000100:00100000:3.0:1787365131.102186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.102264:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688995712 00000100:00100000:2.0:1787365131.102274:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688995712 00000100:00100000:2.0:1787365131.102334:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:2.0:1787365131.102344:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+27:14508:x1874187688995712:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787365131.102431:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.102449:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.102461:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365131.102928:0:16551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787365131.102939:0:16551:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 577332152712ns, next at 578332150554ns, rc = 0 00000004:00010000:2.0:1787365131.103026:0:16551:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8795ac9 reply state 00000000e6a221e2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.103035:0:16551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787365131.104098:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+29:14508:x1874187688995712:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 1750us (1915us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787365131.104108:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 46 00000100:00100000:2.0:1787365131.107342:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365131.107451:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688995840 00000100:00100000:1.0:1787365131.107461:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688995840 00000100:00100000:1.0:1787365131.107549:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 47 00000100:00100000:1.0:1787365131.107560:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+29:14508:x1874187688995840:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787365131.107585:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365131.107608:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e074 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.107670:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 30 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.107685:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 30 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.107705:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:1.0:1787365131.107708:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787365131.107712:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d420c0200, rc 0) 00000100:00100000:1.0:1787365131.107776:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+30:14508:x1874187688995840:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 217us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365131.107811:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 47 00010000:00010000:3.0:1787365131.110512:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.110529:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.110538:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.110544:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28334200 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:3.0:1787365131.110549:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.110558:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.110596:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:3.0:1787365131.110600:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787365131.110605:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.110611:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28334200/0xcfc9272e5fc2c4d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365131.111938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.112024:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688995968 00000100:00100000:2.0:1787365131.112098:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688995968 00000100:00100000:2.0:1787365131.112175:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:2.0:1787365131.112186:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2366:x1874187688995968:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787365131.112563:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2366:x1874187688995968:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 378us (629us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787365131.112587:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00080000:3.0:1787365131.115359:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365131.115636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365131.115715:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688996224 00000100:00100000:0.0:1787365131.115725:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688996224 00000100:00100000:0.0:1787365131.115780:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:0.0:1787365131.115823:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+29:14508:x1874187688996224:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787365131.116153:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+30:14508:x1874187688996224:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 332us (521us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787365131.116161:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 9 00000100:00100000:2.0:1787365131.120331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.120504:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688996480 00000100:00100000:3.0:1787365131.120526:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688996480 00000100:00100000:3.0:1787365131.120622:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:3.0:1787365131.120633:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+30:14508:x1874187688996480:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787365131.120855:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+30:14508:x1874187688996480:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 224us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.120864:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 48 00000100:00100000:1.0:1787365131.130380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365131.130479:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688996608 00000100:00100000:0.0:1787365131.130488:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688996608 00000100:00100000:0.0:1787365131.130560:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:0.0:1787365131.130571:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+30:14508:x1874187688996608:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365131.130603:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365131.130628:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4800/0xcfc9272e5fc2c4e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e07b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.130708:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5400/0xcfc9272e5fc2c4ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.130723:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5400/0xcfc9272e5fc2c4ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.130734:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5400/0xcfc9272e5fc2c4ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365131.130827:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365131.130847:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5400/0xcfc9272e5fc2c4ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.130874:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e4800/0xcfc9272e5fc2c4e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e07b expref: 32 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.130892:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5400/0xcfc9272e5fc2c4ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e07b expref: 31 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.130901:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:0.0:1787365131.130904:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787365131.130908:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e5400, rc 0) 00000100:00100000:0.0:1787365131.130962:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+31:14508:x1874187688996608:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 393us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365131.130969:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 49 00000100:00100000:1.0:1787365131.135304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.135421:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688996736 00000100:00100000:2.0:1787365131.135429:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688996736 00000100:00100000:2.0:1787365131.135484:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:2.0:1787365131.135494:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+6:2367:x1874187688996736:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365131.135512:0:15075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365131.135534:0:15075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e082 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787365131.135564:0:15075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89070a, blocks: 0x1 00010000:00010000:2.0:1787365131.135593:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=577s v=(0 0) 00010000:00010000:2.0:1787365131.135599:0:15075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365131.135610:0:15075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 7 pid: 15075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.135631:0:15075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 7 pid: 15075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.135645:0:15075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d34448c00, rc 0) 00000100:00100000:2.0:1787365131.135703:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:2367:x1874187688996736:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 210us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.135712:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:2.0:1787365131.147293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.147518:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688996992 00000100:00100000:3.0:1787365131.147527:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688996992 00000100:00100000:3.0:1787365131.147599:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 50 00000100:00100000:3.0:1787365131.147627:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+31:14508:x1874187688996992:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787365131.147875:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+31:14508:x1874187688996992:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 266us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.147910:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 50 00000100:00100000:1.0:1787365131.154288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365131.154434:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688997120 00000100:00100000:0.0:1787365131.154443:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688997120 00000100:00100000:0.0:1787365131.154502:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:0.0:1787365131.154511:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+31:14508:x1874187688997120:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787365131.235226:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1787365131.235251:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787365131.235260:0:5878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:0.0:1787365131.235275:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787365131.236535:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714149120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787365131.236628:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365131.237454:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+14:14508:x1874187688997120:12345-192.168.204.2@tcp:44:lhsmtool_posix.0 Request processed in 82939us (83170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.237469:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 51 00000100:00100000:3.0:1787365131.237554:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714149120 00000100:00100000:3.0:1787365131.237563:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714149120 00000100:00100000:3.0:1787365131.237641:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787365131.237663:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714149120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787365131.237903:0:15076:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787365131.237908:0:15076:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787365131.237910:0:15076:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787365131.237912:0:15076:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787365130 -> 1787365130 00002000:00010000:3.0:1787365131.237915:0:15076:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:0.0:1787365131.239493:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365131.239575:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874187714149120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1910us (2942us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787365131.239598:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1787365131.240409:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d409d7480/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787365131.240418:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714149120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787365131.249239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.249343:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688997248 00000100:00100000:2.0:1787365131.249355:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688997248 00000100:00100000:2.0:1787365131.249417:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:2.0:1787365131.249428:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:2366:x1874187688997248:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787365131.249540:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:2366:x1874187688997248:12345-192.168.204.2@tcp:16:lhsmtool_posix.0 Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.249547:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:2.0:1787365131.265296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.266184:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688997504 00000100:00100000:3.0:1787365131.266195:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688997504 00000100:00100000:3.0:1787365131.266328:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 52 00000100:00100000:3.0:1787365131.266341:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+14:14508:x1874187688997504:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787365131.266399:0:16551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365131.266427:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5400/0xcfc9272e5fc2c4ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e07b expref: 14 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.266448:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:3.0:1787365131.266454:0:16551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365131.266485:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.266500:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.266509:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365131.269911:0:16551:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000888bde45 reply state 000000004e7abf65 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.269931:0:16551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787365131.270890:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+15:14508:x1874187688997504:12345-192.168.204.2@tcp:36:lhsmtool_posix.0 Request processed in 4543us (5594us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787365131.270901:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 52 00000100:00100000:2.0:1787365131.276634:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365131.276898:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714149248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365131.277440:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365131.277511:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714149248 00000100:00100000:2.0:1787365131.277520:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714149248 00000100:00100000:2.0:1787365131.277566:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787365131.277576:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874187714149248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365131.278237:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365131.278294:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874187714149248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 719us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.278768:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787365131.279019:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714149248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365131.280128:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365131.280160:0:15807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688997632 00000100:00100000:0.0:1787365131.280176:0:15807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688997632 00000100:00100000:0.0:1787365131.280224:0:15807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:0.0:1787365131.280235:0:15807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:14508:x1874187688997632:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365131.280251:0:15807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365131.280269:0:15807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3aab39acfd67e089 expref: -99 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.280303:0:15807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 8 pid: 15075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.280313:0:15807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365131.280317:0:15807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365131.280323:0:15807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 8 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.280359:0:15807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 8 pid: 15075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.280374:0:15807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 8 pid: 15075 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365131.280389:0:15807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d401ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15807:1874187714149376:192.168.204.2@tcp:104: 00000100:00100000:0.0:1787365131.280461:0:15807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d11adc900 going to sleep for 11 seconds 00010000:00010000:2.0:1787365131.280713:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.280723:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.280730:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.280736:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.280741:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.280749:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.280765:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:2.0:1787365131.280768:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365131.280773:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.280780:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d00030e00/0xcfc9272e5fc2c4fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365131.287347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.287382:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688997760 00000100:00100000:3.0:1787365131.287391:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688997760 00010000:00010000:3.0:1787365131.287431:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 9 pid: 15075 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365131.287465:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:3.0:1787365131.287473:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:2366:x1874187688997760:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365131.287487:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365131.287509:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 9 pid: 15075 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.287522:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 9 pid: 15075 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.287548:0:14376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365131.287553:0:14376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365131.287560:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 9 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.287570:0:14376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 9 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.287606:0:14376:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 9 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365131.287636:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6c078d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14376:1874187714149504:192.168.204.2@tcp:105: 00000100:00100000:3.0:1787365131.287726:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d3fe49000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365131.293536:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6c078d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14376:1874187714149504:192.168.204.2@tcp:105: 00010000:00010000:3.0:1787365131.293563:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365131.293627:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:2366:x1874187688997760:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 6152us (6288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.293640:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 13 00010000:00010000:0.0:1787365131.297358:0:15807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c4f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e082 expref: 8 pid: 15075 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365131.297418:0:15807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d401ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15807:1874187714149376:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787365131.297449:0:15807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 7 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.297465:0:15807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d342e4800, rc 0) 00000100:00100000:0.0:1787365131.297539:0:15807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:14508:x1874187688997632:12345-192.168.204.2@tcp:101:lhsmtool_posix.0 Request processed in 17306us (17416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365131.297549:0:15807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 17 00000100:00100000:1.0:1787365131.306638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.312295:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688997888 00000100:00100000:2.0:1787365131.312311:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688997888 00000100:00100000:2.0:1787365131.312375:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:2.0:1787365131.312386:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:2367:x1874187688997888:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787365131.312623:0:15075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787365131.312634:0:15075:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787365129 00002000:00010000:2.0:1787365131.312637:0:15075:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787365128 00002000:00010000:2.0:1787365131.312639:0:15075:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787365130 -> 1787365129 00002000:00010000:2.0:1787365131.312642:0:15075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787365131.312708:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+8:2367:x1874187688997888:12345-192.168.204.2@tcp:2:lhsmtool_posix.0 Request processed in 324us (6080us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787365131.312716:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 18 00000100:00100000:3.0:1787365131.317581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.318144:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688998016 00000100:00100000:2.0:1787365131.318155:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688998016 00000100:00100000:2.0:1787365131.318291:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:2.0:1787365131.318302:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c078d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+8:2366:x1874187688998016:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787365131.318351:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.318370:0:15076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 8 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.318380:0:15076:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365131.318384:0:15076:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787365131.318389:0:15076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.318421:0:15076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 8 pid: 15807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.318436:0:15076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 8 pid: 15807 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.318473:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15076:1874187714149632:192.168.204.2@tcp:104: 00000100:00100000:2.0:1787365131.318552:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d0133a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365131.322747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.322781:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688998144 00000100:00100000:3.0:1787365131.322812:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688998144 00010000:00010000:3.0:1787365131.322851:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 9 pid: 15807 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365131.322885:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:3.0:1787365131.322896:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:2366:x1874187688998144:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365131.322911:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365131.322936:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 9 pid: 15807 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.322950:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 9 pid: 15807 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.322973:0:14375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365131.322990:0:14375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365131.322996:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.323006:0:14375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.323025:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365131.323090:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:2366:x1874187688998144:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 196us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.323098:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00010000:00010000:2.0:1787365131.323395:0:15076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027598d0e/0xcfc9272e5fc2c501 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e089 expref: 8 pid: 15807 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.323412:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15076:1874187714149632:192.168.204.2@tcp:104: 00010000:00010000:2.0:1787365131.323434:0:15076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323445:0:15076:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323452:0:15076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323477:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323484:0:15076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323490:0:15076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323508:0:15076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365131.323512:0:15076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323521:0:15076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323534:0:15076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.323542:0:15076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c508 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.323600:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c078d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:2366:x1874187688998016:12345-192.168.204.2@tcp:1:lhsmtool_posix.0 Request processed in 5300us (6029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.323608:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 19 00000100:00100000:1.0:1787365131.332447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365131.332484:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688998400 00000100:00100000:1.0:1787365131.332492:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688998400 00000100:00100000:1.0:1787365131.332546:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 53 00000100:00100000:1.0:1787365131.332556:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+14:14508:x1874187688998400:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787365131.332639:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.332656:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.332668:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.332941:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.332954:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 15 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.332962:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.333008:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 15 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.333022:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 15 pid: 14390 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365131.333036:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1874187714149760:192.168.204.2@tcp:104: 00000100:00100000:1.0:1787365131.333407:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98c00 going to sleep for 11 seconds 00000001:00080000:3.0:1787365131.336713:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1787365131.336731:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000100:00100000:3.0:1787365131.339138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365131.339276:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688998528 00000100:00100000:0.0:1787365131.339285:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688998528 00000100:00100000:1.0:1787365131.339299:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1874187714149760:192.168.204.2@tcp:104: 00010000:00010000:0.0:1787365131.339333:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 16 pid: 14390 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.339334:0:14390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365131.339371:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:0.0:1787365131.339380:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+16:2367:x1874187688998528:12345-192.168.204.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365131.339405:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365131.339414:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 16 pid: 14390 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.339426:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 16 pid: 14390 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.339454:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c0200/0xcfc9272e5fc2c4de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e074 expref: 16 pid: 14390 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.339489:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:0.0:1787365131.339494:0:14376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.339504:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.339511:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.339539:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365131.339564:0:14390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.339572:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365131.339597:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+15:2367:x1874187688998528:12345-192.168.204.2@tcp:103:ldlm_bl.0 Request processed in 218us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365131.339605:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 15 00000001:00080000:1.0:1787365131.339757:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787365131.340340:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787365131.340385:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787365131.340464:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14390:1874187714149888:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787365131.340533:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365131.340567:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d409b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365131.340722:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714149888 00000100:00100000:0.0:1787365131.340728:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714149888 00000100:00100000:0.0:1787365131.340771:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365131.340779:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14390:x1874187714149888:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787365131.340887:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14390:x1874187714149888:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365131.340894:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365131.340943:0:14390:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934595 gen 2 00000004:00080000:2.0:1787365131.340949:0:14390:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d409d7480, transno 8589934595 00000100:00100000:2.0:1787365131.340969:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14390:1874187714149888:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787365131.341754:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787365131.341840:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14390:1874187714150016:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787365131.341881:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365131.341908:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365131.342400:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714150016 00000100:00100000:0.0:1787365131.342406:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714150016 00000100:00100000:0.0:1787365131.342437:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365131.342445:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d409d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14390:x1874187714150016:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787365131.342843:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d409d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14390:x1874187714150016:12345-0@lo:1000:mdt00_000.0 Request processed in 397us (959us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787365131.342864:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365131.343265:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14390:1874187714150016:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787365131.343316:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343328:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343335:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343340:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.343345:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343353:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343368:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:2.0:1787365131.343371:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365131.343376:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343382:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1e00/0xcfc9272e5fc2c516 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343414:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343420:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343426:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343439:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d28335e00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.343442:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343448:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343457:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365131.343459:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365131.343466:0:14390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5e00/0xcfc9272e5fc2c475 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e058 expref: 18 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343478:0:14390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5e00/0xcfc9272e5fc2c475 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e058 expref: 18 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343487:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5e00/0xcfc9272e5fc2c475 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e058 expref: 18 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.343518:0:14390:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5e00/0xcfc9272e5fc2c475 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.2@tcp remote: 0x3aab39acfd67e058 expref: 18 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.343529:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d409d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1874187714150144:192.168.204.2@tcp:105: 00000100:00100000:2.0:1787365131.343594:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6d02f98c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365131.346833:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d409d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1874187714150144:192.168.204.2@tcp:105: 00010000:00010000:2.0:1787365131.346864:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346889:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d28335e00/0xcfc9272e5fc2c46e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346924:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346937:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346949:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346960:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346965:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346972:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346977:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.346981:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346989:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.346999:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365131.347001:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365131.347005:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.347017:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d34448c00/0xcfc9272e5fc2c51d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.347348:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.347357:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.347362:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.347367:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1800 already unused, calling callback (ffffffffc211c4f0) 00010000:00010000:2.0:1787365131.347370:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.347376:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.347387:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d02948700) 00010000:00010000:2.0:1787365131.347389:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787365131.347392:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.347398:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d420c1800/0xcfc9272e5fc2c50f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.347703:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+18:14508:x1874187688998400:12345-192.168.204.2@tcp:57:lhsmtool_posix.0 Request processed in 15146us (15264us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787365131.347713:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 53 00000020:00080000:2.0:1787365131.347724:0:14390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787365131.348264:0:14422:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787365131.348269:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365131.348298:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787365131.348315:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787365131.350435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.351014:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688998656 00000100:00100000:2.0:1787365131.351088:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688998656 00000100:00100000:2.0:1787365131.351600:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:2.0:1787365131.351610:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d0548d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+18:14507:x1874187688998656:12345-192.168.204.2@tcp:49:dd.0 00000100:00100000:2.0:1787365131.351753:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d0548d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+18:14507:x1874187688998656:12345-192.168.204.2@tcp:49:dd.0 Request processed in 145us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.351761:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 10 00000100:00100000:3.0:1787365131.355695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365131.355807:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688998912 00000100:00100000:0.0:1787365131.355817:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688998912 00000100:00100000:0.0:1787365131.355872:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 11 00000100:00100000:0.0:1787365131.355883:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+18:14508:x1874187688998912:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787365131.356842:0:14394:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787365131.356967:0:14394:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787365131.357009:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.358451:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.358469:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.358477:0:14394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.358483:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.358488:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.358518:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365131.358560:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365131.358567:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.358574:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e5c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365131.358577:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.358585:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.358598:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d12906e00) 00010000:00010000:3.0:1787365131.358601:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787365131.358616:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.358622:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d342e5c00/0xcfc9272e5fc2c524 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.358636:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365131.358638:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365131.358638:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+20:14508:x1874187688998912:12345-192.168.204.2@tcp:35:lhsmtool_posix.0 Request processed in 2754us (2949us total) trans 8589934622 rc 0/0 00010000:00010000:3.0:1787365131.358639:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365131.358647:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 11 00000020:00080000:0.0:1787365131.358659:0:14394:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787365131.518742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.518889:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688999168 00000100:00100000:2.0:1787365131.518900:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688999168 00000100:00100000:1.0:1787365131.518915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:2.0:1787365131.519475:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688999040 00000100:00100000:2.0:1787365131.519480:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688999040 00000100:00100000:2.0:1787365131.519505:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:2.0:1787365131.519516:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d401ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+7:2367:x1874187688999168:12345-192.168.204.2@tcp:4:dd.0 00002000:00010000:2.0:1787365131.519568:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a890709, atime: 0x6a890708, ctime: 0x6a890709, blocks: 0x1 00010000:00010000:2.0:1787365131.519577:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.519593:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=577s v=(0 0) 00010000:00010000:2.0:1787365131.519597:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365131.519603:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.519618:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365131.531871:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.531934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.531957:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.531969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.532003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:3.0:1787365131.532069:0:15080:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787365131.532081:0:15080:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787365131.532465:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787365131.532493:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688999296 00000100:00100000:2.0:1787365131.532504:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688999296 00000100:00100000:2.0:1787365131.532557:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787365131.532562:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688999424 00000100:00100000:2.0:1787365131.532565:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688999424 00000100:00100000:2.0:1787365131.532577:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787365131.532582:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688999552 00000100:00100000:2.0:1787365131.532584:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688999552 00000100:00100000:2.0:1787365131.532594:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787365131.532600:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688999680 00000100:00100000:2.0:1787365131.532602:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688999680 00000100:00100000:2.0:1787365131.532612:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787365131.532619:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688999808 00000100:00100000:2.0:1787365131.532621:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688999808 00010000:00010000:0.0:1787365131.533509:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365131.534467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365131.534670:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787365131.534682:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187688999936 00000100:00100000:1.0:1787365131.534690:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187688999936 00000100:00100000:2.0:1787365131.542413:0:16625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:2.0:1787365131.542434:0:16625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+14:2367:x1874187688999040:12345-192.168.204.2@tcp:4:dd.0 00010000:00010000:2.0:1787365131.542487:0:16625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.542506:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365131.542511:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365131.542517:0:16625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.542532:0:16625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365131.665141:0:16625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1787365131.665150:0:16625:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787365129 -> 1787365130 00002000:00010000:0.0:1787365131.665152:0:16625:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787365129 -> 1787365130 00002000:00010000:0.0:1787365131.665155:0:16625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1787365131.665169:0:16625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.665182:0:16625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.665191:0:16625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.665198:0:16625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34449800 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365131.665204:0:16625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.665213:0:16625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.665231:0:16625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.665240:0:16625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000b24576/0xcfc9272e5fc2c532 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365131.665355:0:16625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+18:2367:x1874187688999040:12345-192.168.204.2@tcp:4:dd.0 Request processed in 122924us (146435us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787365131.665369:0:16625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 1 00000100:00100000:0.0:1787365131.665399:0:16625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:0.0:1787365131.665409:0:16625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6c04b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+17:2366:x1874187688999296:12345-192.168.204.2@tcp:4:dd.0 00010000:00010000:0.0:1787365131.665437:0:16625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.665449:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365131.665454:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365131.665460:0:16625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.665473:0:16625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787365131.665947:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1787365131.665958:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1787365131.665968:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00010000:00010000:3.0:1787365131.666001:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.666010:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.666028:0:15079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.666045:0:15079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365131.666056:0:15079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.666064:0:15079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.666077:0:15079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.666084:0:15079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c52b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365131.666126:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d401ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+12:2367:x1874187688999168:12345-192.168.204.2@tcp:4:dd.0 Request processed in 146610us (147393us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787365131.666133:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 0 00000100:00100000:3.0:1787365131.666149:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:3.0:1787365131.666157:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+11:2366:x1874187688999424:12345-192.168.204.2@tcp:4:dd.0 00010000:00010000:3.0:1787365131.666174:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.666182:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365131.666186:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365131.666190:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.666199:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787365131.748677:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1787365131.753600:0:16625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:2.0:1787365131.753610:0:16625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1787365131.753624:0:16625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.753654:0:16625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.753663:0:16625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.753671:0:16625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d342e4600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365131.753676:0:16625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.753685:0:16625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.753706:0:16625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.753713:0:16625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007aa03a0/0xcfc9272e5fc2c539 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.753846:0:16625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6c04b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+13:2366:x1874187688999296:12345-192.168.204.2@tcp:4:dd.0 Request processed in 88434us (221981us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787365131.753857:0:16625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 2 00000100:00100000:2.0:1787365131.753893:0:16625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:2.0:1787365131.753906:0:16625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+12:2366:x1874187688999552:12345-192.168.204.2@tcp:4:dd.0 00010000:00010000:2.0:1787365131.753940:0:16625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.753959:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365131.753964:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365131.753969:0:16625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.753981:0:16625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787365131.786052:0:15079:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00010000:00010000:2.0:1787365131.786076:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.786090:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.786100:0:15079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.786107:0:15079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00031c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365131.786111:0:15079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.786120:0:15079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.786142:0:15079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.786168:0:15079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d88f1d5/0xcfc9272e5fc2c540 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.786267:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+14:2366:x1874187688999424:12345-192.168.204.2@tcp:4:dd.0 Request processed in 120105us (254327us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787365131.786278:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 3 00000100:00100000:2.0:1787365131.786323:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:2.0:1787365131.786337:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+13:2366:x1874187688999680:12345-192.168.204.2@tcp:4:dd.0 00010000:00010000:2.0:1787365131.786368:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.786379:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787365131.786384:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365131.786390:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.786402:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787365131.787277:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000100:00100000:3.0:1787365131.799948:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714150272:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800020:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365131.800074:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714150784:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800102:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365131.800130:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787365131.800136:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714150400:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800161:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365131.800180:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714150912:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800201:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365131.800231:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714150528:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365131.800272:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787365131.800278:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d342ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714150656:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800368:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365131.800405:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714150272 00000100:00100000:3.0:1787365131.800412:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714150272 00000100:00100000:3.0:1787365131.800457:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787365131.800466:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d18192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3315:x1874187714150272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800520:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d18192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07eb110b-5671-42a1-88c0-bbf646942aa8+19:3315:x1874187714150272:12345-0@lo:400:kworker.0 Request processed in 55us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.800528:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787365131.800562:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714150784 00000100:00100000:3.0:1787365131.800566:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714150784 00000100:00100000:3.0:1787365131.800611:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714150912 00000100:00100000:3.0:1787365131.800614:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714150912 00000100:00100000:3.0:1787365131.800627:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714150656 00000100:00100000:3.0:1787365131.800629:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714150656 00000100:00100000:3.0:1787365131.800643:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365131.800649:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800682:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874187714150784:12345-0@lo:400:kworker.0 Request processed in 33us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.800688:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365131.800699:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787365131.800705:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800730:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874187714150912:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.800735:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787365131.800746:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787365131.800751:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714150656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800779:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874187714150656:12345-0@lo:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.800807:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787365131.800825:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714150400 00000100:00100000:3.0:1787365131.800828:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714150400 00000100:00100000:3.0:1787365131.800850:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714150528 00000100:00100000:3.0:1787365131.800853:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714150528 00000100:00100000:3.0:1787365131.800872:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365131.800878:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714150400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800908:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874187714150400:12345-0@lo:400:kworker.0 Request processed in 30us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.800923:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365131.800935:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787365131.800941:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714150528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.800968:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714150528:12345-0@lo:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365131.800974:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787365131.801001:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787365131.801006:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365131.801055:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874187714150656:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.801067:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714150528:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.801309:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787365131.801317:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787365131.801338:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1874187714150400:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.801348:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1874187714150912:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.801356:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07eb110b-5671-42a1-88c0-bbf646942aa8:3315:1874187714150272:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.801365:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d342ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1874187714150784:0@lo:400:kworker.0 00000100:00100000:3.0:1787365131.804417:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714151040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365131.804485:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365131.804619:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187714151040 00000100:00100000:1.0:1787365131.804628:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187714151040 00000100:00100000:1.0:1787365131.804676:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787365131.804685:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714151040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365131.804722:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365131.804779:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874187714151040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365131.804809:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787365131.804890:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6d2ffbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1874187714151040:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787365131.829889:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1787365131.833559:0:16625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1787365131.833570:0:16625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1787365131.833584:0:16625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.833597:0:16625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.833606:0:16625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.833613:0:16625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:1.0:1787365131.833617:0:16625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.833650:0:16625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.833676:0:16625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.833684:0:16625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe32d85/0xcfc9272e5fc2c547 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365131.833782:0:16625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+11:2366:x1874187688999552:12345-192.168.204.2@tcp:4:dd.0 Request processed in 79875us (301817us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787365131.833832:0:16625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 4 00000100:00100000:1.0:1787365131.833865:0:16625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 6 00000100:00100000:1.0:1787365131.833878:0:16625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+10:2366:x1874187688999808:12345-192.168.204.2@tcp:4:dd.0 00010000:00010000:1.0:1787365131.833908:0:16625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.833919:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365131.833923:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365131.833929:0:16625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365131.833941:0:16625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787365131.875065:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1787365131.879929:0:15079:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1787365131.879941:0:15079:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1787365131.879956:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.879979:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.879989:0:15079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.879997:0:15079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d34448c00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:3.0:1787365131.880002:0:15079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.880011:0:15079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.880048:0:15079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.880056:0:15079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0ac8707/0xcfc9272e5fc2c54e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365131.880153:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+10:2366:x1874187688999680:12345-192.168.204.2@tcp:4:dd.0 Request processed in 93817us (348177us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787365131.880163:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 5 00000100:00100000:3.0:1787365131.880197:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 7 00000100:00100000:3.0:1787365131.880209:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d342adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:2366:x1874187688999936:12345-192.168.204.2@tcp:4:dd.0 00010000:00010000:3.0:1787365131.880241:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.880259:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365131.880264:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365131.880271:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365131.880283:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365131.906346:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1787365131.907161:0:16625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:2.0:1787365131.907183:0:16625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.907217:0:16625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.907225:0:16625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.907232:0:16625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d420c1e00 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:2.0:1787365131.907237:0:16625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.907247:0:16625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.907269:0:16625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365131.907276:0:16625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9947cd/0xcfc9272e5fc2c555 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.907368:0:16625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d7f027af-e21f-4925-9029-fcde5f8f5a2f+9:2366:x1874187688999808:12345-192.168.204.2@tcp:4:dd.0 Request processed in 73490us (375360us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787365131.907379:0:16625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 6 00000001:00080000:3.0:1787365131.939486:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1787365131.939866:0:15079:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1787365131.939884:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.939897:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.939905:0:15079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.939923:0:15079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d00030600 already unused, calling callback (ffffffffc16fd420) 00010000:00010000:0.0:1787365131.939928:0:15079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.939938:0:15079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.939958:0:15079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365131.939966:0:15079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b00a86e6/0xcfc9272e5fc2c55c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365131.940237:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d342adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2366:x1874187688999936:12345-192.168.204.2@tcp:4:dd.0 Request processed in 60025us (405772us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787365131.940250:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 7 00010000:00010000:1.0:1787365132.559243:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787365133.487937:0:16664:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787365133.582766:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365134.107258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365134.107402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365134.107444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365134.107481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365134.107498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365134.107513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:1.0:1787365134.107552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.2@tcp (source: 12345-192.168.204.2@tcp) 00000100:00100000:0.0:1787365134.107663:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187689000576 00000100:00100000:0.0:1787365134.107674:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187689000576 00000100:00100000:0.0:1787365134.107750:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187689000192 00000100:00100000:0.0:1787365134.107754:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187689000192 00000100:00100000:0.0:1787365134.107780:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:0.0:1787365134.107823:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2364:x1874187689000576:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365134.107925:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b87453e-debf-4f7b-9b54-26b3375a65eb+6:2364:x1874187689000576:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 104us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365134.107934:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 29 00000100:00100000:0.0:1787365134.107954:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00100000:0.0:1787365134.107961:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+20:2364:x1874187689000192:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:0.0:1787365134.108018:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7f027af-e21f-4925-9029-fcde5f8f5a2f+20:2364:x1874187689000192:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 57us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365134.108035:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 30 00000100:00080000:1.0:1787365134.108483:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365134.110412:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187689000320 00000100:00100000:3.0:1787365134.110427:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187689000320 00000100:00100000:3.0:1787365134.110488:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187689000832 00000100:00100000:3.0:1787365134.110491:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187689000832 00000100:00100000:3.0:1787365134.110502:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187689000448 00000100:00100000:3.0:1787365134.110504:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187689000448 00000100:00100000:3.0:1787365134.110515:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187689000704 00000100:00100000:3.0:1787365134.110518:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187689000704 00000100:00100000:3.0:1787365134.110537:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:3.0:1787365134.110546:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d2ffbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2364:x1874187689000320:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787365134.110625:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d2ffbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2364:x1874187689000320:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 80us (3224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365134.110633:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 13 00000100:00100000:3.0:1787365134.110648:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:3.0:1787365134.110654:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2364:x1874187689000832:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787365134.110675:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2364:x1874187689000832:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 21us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365134.110693:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 14 00000100:00100000:3.0:1787365134.110703:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:3.0:1787365134.110708:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2364:x1874187689000448:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787365134.110726:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7f027af-e21f-4925-9029-fcde5f8f5a2f+5:2364:x1874187689000448:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 18us (3212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365134.110742:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 15 00000100:00100000:3.0:1787365134.110751:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00100000:3.0:1787365134.110756:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d34241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2364:x1874187689000704:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:3.0:1787365134.110775:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d34241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b87453e-debf-4f7b-9b54-26b3375a65eb+5:2364:x1874187689000704:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 20us (3224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365134.110781:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 16 00000100:00080000:1.0:1787365134.111568:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365134.111574:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365134.111689:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874187689000064 00000100:00100000:2.0:1787365134.111697:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874187689000064 00000100:00100000:2.0:1787365134.111748:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.2@tcp, seq: 123 00000100:00100000:2.0:1787365134.111756:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d18192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+13:2364:x1874187689000064:12345-192.168.204.2@tcp:400:kworker.0 00000100:00100000:2.0:1787365134.111865:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d18192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aafc759a-56d4-42f5-b653-14dd754db9dc+13:2364:x1874187689000064:12345-192.168.204.2@tcp:400:kworker.0 Request processed in 109us (4620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365134.111872:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.2@tcp, seq: 123 00010000:00010000:1.0:1787365134.607561:0:15561:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30066 lines, 30066 kept, 0 dropped, 0 bad.